Playdate (the came console) is amazing for this! I was really bored once and built a Claude Code remote control for Playdate.
Voice recognition was done via parrot + handy.computer Basically: different key combos were tied to different actions, e.g. \
- hold A to speak
- move the crank slowly to navigate
- crank super fast to send the prompt
Eventually this became a universal remote control for the computers in my home (YAML file with bindings from Playdate UI → A11y events).
Using the crank to control movies is fun!(I can share the source -- just let me know if this is actually useful)
Also, I feel like the author and me have similar hobbies. A few years back I almost won a (re-sellable on Ebay) award for https://meat-gpt.sonnet.io !
(I lost to a gallery of 3d sandwiches)
I really wanted to like the Playdate but it's such an unbelievably overpriced and underspecced toy. But the crank, which really looked like a gimmick, is oddly quite nice to have and I wish my kids' Retro Arcade had one.
I have one too and it never occurred to me to use it for anything other than games. Would be interested in seeing how you did it!