Angela Rayner's ministerial staff are furious that the government won't negotiate on flexible work or office closures.