alt Hacker NewsI have built npm for LLM models, which lets you install & run 10,000+ open sourced large language models within seconds. The idea is to make models installable like packages in your code:
llmpm install llama3
llmpm run llama3
You can also package large language models together with your code so projects can reproduce the same setup easily.
Looks crazy! Thanks for building it, there is indeed a need for a npm or pip like package manager for AI Models.