Hmm. What would be really helpful for me would be an enhancement of the TypeWhisper app for dictation that would be able to get the context of what I am dictating into and send it along with the prompt to an LLM.

Probably much simpler and much less of a privacy problem (I run my own local LLM for that purpose so that nothing leaves the machine).