alt Hacker NewsI see this is using GPT4o, any plans for something more sustainable? Would be interesting to see an https://openfreemap.org for LLMs.
Perhaps via an RNN like in https://huggingface.co/spaces/BlinkDL/RWKV-Gradio-2
Or even just leverage huggingface gradio spaces? (most are Gradio apps that expose APIs https://www.gradio.app/guides/view-api-page)
I wonder if a 1B model could be close to free to host. That's an eventuality, but I wonder how long it'll take for that to be real.