> when work is done, I leave, and it's done

This might speak to the whip I have worked under, rarely has this been the case for me. Just demanding jobs with too much to do. Office is where you go in super early (or WFH super early) to focus for two hours, then office to do a bunch of meetings and unfocused work, and then home is where you get to pick back up for the real work. One gig, I'd call in wfh simply because I was working before commuting and got too carried away (ie: late) for it to actually be worth going in.

I very much agree with the potential drawbacks. Not having a twice daily 40 minute bike ride was a very major adjustment.