This app isn't very useful but it did get me thinking.

I have a phone in a drawer I could install termux and ollama on over tailscale and then I'd have an always on llm for super light tasks.

I do really long for a private chat bot but I simply don't have access to the hardware required. Sadly I think it's going to be years to get there..