logoalt Hacker News

yipinwongtoday at 7:18 PM1 replyview on HN

The target audience is who needs raw speed.

Having the choice is good as you can make a trade-off between speed, perf, and quality.

Until last year, people had a single AI god they believed in (mostly Anthropic stuff). Now we have power to make choices (open-weights, SOTA, speed-optimized, etc) the same way you do for system designs.


Replies

vb-8448today at 7:36 PM

It's not a criticism, I was really looking forward to trying out such a powerful model at this speed.

But I burn my 5$ allowance in 10 minutes ... and only because I was hitting rate limits, without it would probably be less than a minute.

show 1 reply