The trick is getting those two days of being in the office and talking and interacting to sum up to be things you can put on your perf packet. those two days aren't "lost". they can be a different kind of work, which culminates into leading teams and mentoring people. work comes in many forms.
I WFH, even work on weekends. I notice that after working weekends I feel tired on Mondays, so I decided to spend Mondays on less technical stuff, e.g. customer meetings, interviews, lead generation etc