I've encountered the exact same issue. What helped me somewhat, at least with the video playback, is opening videos in embed player.

I coded an extension that adds a context menu for opening videos in embed mode. https://addons.mozilla.org/pl/firefox/addon/youtube-open-as-...