alt Hacker NewsSpeech recognition, speech generation.
This alone is quite useful in small/limited devices/contexts.
Realtime log parsing and summarization is another application I've seen for little LLM's..
Basically, anywhere you'd use an LLM, but at much, much smaller scales of ontology.
speech models are what I'm trying next because imagine a nice portable meeting transcription device that can hold around without internet and for NDA-ed meetings and so (with permission of course)