> almost every team has only one or two members in the same physical location.

I was in a similar situation. I wouldn't mind coming in because in person discussions have their their benefit but I resented being made to come in just to sit on Teams calls all day. It was open plan (of course) and everyone else in the giant space with hard surfaces were also on team calls. Even my line manager was in a different physical location.