I had this same realization while playing video games and my senior dog came over for pets. Realized I felt like I was wasting my downtime on essentially meaningless filler when I could be spending it with him instead.

Mind you this was solo video game so I wasn't even spending quality time with friends online or anything.

I agree with the sentiment of the other comments here that its been like this for longer than OP gives credit for (10 years). But I don't think that makes it right. As hunter-gatherers, when we weren't hunting or gathering, I feel like people were probably just spending time with each other? If we take that 40 hour/week figure as canon for how much hunter/gatherers worked, anyways.