That has been my experience as well. So far nothing has come close to the flexibility of Gnome (upscaled) with an airmouse. I am keeping an eye on the Plasma Bigscreen project however (10-foot UI for Plasma).
An alternative could be some x86 Android TV build like Lineage, but I have not seen very convincing demonstrations that this is truly viable.