True. I believe the most important question right now is… how to solve for memory.
RAG and/or Fine-tuning is not the way.
Another topic is security, which would consist of using Ollama + Proxmox for example, but of course, right now, as emergent intelligence is still early, we would have to wait 2-3 years for ~8 B parameter local models to be as good as ChatGPT o3 pro or Claude Opus 4.
I do believe that we are close to discovering a new interface. What is now presenting itself through IDE’s and the command line (terminal)… I strongly believe we are 1-2 years away from a new kind of interface, that is not meant for developers only.
That feels like an IDE, works like a CLI, but is intuitive as Chrome is for browsing the web.