logoalt Hacker News

autuni • today at 7:30 AM • 2 replies • view on HN

I think this kind of change will pop up more often.

In software engineering, we learned a long time ago that giant monoliths are not the answer. You want smaller, but specialized units that work together. They perform better at their specific task, are more maintainable, you can just upgrade one part of the system without having to impact the others, ....

I don't know where the focus on building a single model that can do everything comes from.


Replies

Geezus_42 • today at 7:41 AM

I was thinking about this recently as well. Smaller, specialized models that can run on device just make so much more sense to me than these huge generalized models that need huge infrastructure run.

ivell • today at 8:15 AM

I am not sure a best practice in one area translates nicely to another. LLM's power comes with it being a monolith.

➕ show 2 replies