I feel that my highest productivity was the 4 years I spent on the same team working remotely but having many interactions per day with my coworkers and manager. I only physically was in-person with my team for 1 week during that 4 year span. But every day I was working WITH my teammates, interactively. My manager was open and honest about things and the company culture embraced discussing "What if we did X?" to debate how we could improve things and dream up new ideas.

Prior to that I worked in-person in offices doing similar types of engineering. I was never as productive there but I did see more sides of the business and I got to do more varied tasks. Having lunch or going for a short walk physically with teammates and non-teammates definitely spawns opportunities which otherwise don't naturally happen.

Now, I do consulting/contracting remotely. Often I'm working on weeks to months long contracts. All my customers are remote. It's very clear that my value is in short term results, to get the customer past their current problem. If any planning for the future is found, I recommend it, but unless the customer wants me to pursue it then the recommendation is all I give.

All 3 kinds of work have pros and cons. I do miss regularly having lunch with coworkers. I MUCH prefer my remote work commute, flexibility, and work/life balance.