alt Hacker NewsWouldn't it be nice if we have language specific llms that work on average computers.
Like LLM that only trained on Python 3+, certain frameworks, certain code repos. Then you can use a different model for searching the internet to implement different things to cut down on costs.
Maybe I have no idea what I'm talking about lol
I imagine some sort of distill like this would be possible, but I think multi-language training really helps the LLM.