logoalt Hacker News

metabrewtoday at 11:16 AM4 repliesview on HN

I tried the chatbot. jarring to see a large response come back instantly at over 15k tok/sec

I'll take one with a frontier model please, for my local coding and home ai needs..


Replies

grzracztoday at 11:27 AM

Absolute insanity to see a coherent text block that takes at least 2 minutes to read generated in a fraction of a second. Crazy stuff...

show 3 replies
stabblestoday at 11:42 AM

Reminds me of that solution to Fermi's paradox, that we don't detect signals from extraterrestrial civilizations because they run on a different clock speed.

show 2 replies
pennomitoday at 4:12 PM

Yeah, feeding that speed into a reasoning loop or a coding harness is going to revolutionize AI.