logoalt Hacker News

azinman2last Wednesday at 5:04 PM3 repliesview on HN

It seems in general we’re heading toward’s Minsky’s society of minds concept. I know OpenAI is wanting to collapse all their models into a single omni model that can do it all, but I wonder if under the hood it’d just be about routing. It’d make sense to me for agents to specialize in certain tool calls, ways of thinking, etc that as a conceptual framework/scaffolding provides a useful direction.


Replies

mythrwylast Wednesday at 5:39 PM

I wonder if OpenAI might be routing already based on speed of some "O1" responses I receive. It does make sense.

show 1 reply
yjftsjthsd-hlast Wednesday at 5:26 PM

Isn't that kinda the idea of Mixture of Experts?

funnyAIlast Thursday at 4:10 AM

"conceptual framework" can actually be another generalist model. Splitting model also comes with some advantages. Like easy separate tuning and replacements. Easy scaling by simply duplicating heavily used model on new hardware.