logoalt Hacker News

enraged_camel • yesterday at 10:30 PM • 1 reply • view on HN

Context is useful. The parent said: "it's a cheaper product that's almost as good or better in some cases"

The only open models that are "almost as good or better in some cases" require massive amounts of RAM. I posit that most people cannot afford a decked out Mac Studio, and therefore run the smaller "flash" variants on more normal devices. The issue is that those are nowhere near frontier-level in terms of capability.


Replies

CharlieDigital • yesterday at 10:39 PM

"Running your own infra" also includes managed infra like Bedrock, Foundry, etc.

Not just your local machines.

Enterprises are where you see this adoption. Legal, finance, tax; sensitive context where the data must be contractually opaque to external parties.

➕ show 1 reply