Sounds like you don't have a lot of remote work experience.
The majority of my career (years before the pandemic) has been remote work. I find in office work painfully slow. I pair program quite often remote, and when someone gets stuck we also "just talk". Honestly I prefer screen sharing to leaning over someone's shoulder (much easier to doing supporting work in parallel).
I find it really depends on the type of org though. Large corporate places do tend to suffer from remote work because so much of the work is performative anyway. Remote small companies and startups the velocity is very high, but you do need more senior people capable of independent work.
Especially when you factor in the easy of "after hours" work, the amount of emergency stuff I've shipped around midnight is incomparable to the 'in office' equivalent.
Though I suspect the key word here is "my 2 programmers", I find managers don't feel like their doing work unless they're physically watching it get done.
Not understanding how to run a remote team is not the same as remote teams not being effective in principle.