"It’s oddly difficult to do nothing"

This isn't always true. It's likely true only when there is no pressure. However, when there is pressure, one can "do nothing" for long periods. If you haven't experienced that, you've lived a blessed life, and you have more to learn.