alt Hacker NewsCan't wait to try it. Made a small log app for my IBS which allows free text input and uses LLM to create JSON. If that could be done on device with a foundation model, it would be awesome. (and also completely bomb my income model)
Can't wait to try it. Made a small log app for my IBS which allows free text input and uses LLM to create JSON. If that could be done on device with a foundation model, it would be awesome. (and also completely bomb my income model)
I think that can pretty realistically be done with Gemma or Qwen, although maybe with some delay. They run great on android in the Edge Gallery app.
Further, you could allow for voice input by running whisper STT locally, then doing a small context-aware correction pass with Gemma or Qwen to correct words it got wrong.