This is the coolest LLM thing I’ve seen since the original ChatGPT announcement a few years ago. IMO much more impressive than marginal gains of frontier models.

I know it's a relatively tiny model, but damn, is that thing fast.

It also mostly passes the "schlong" test

https://pastes.io/YcxSi8Fp

I freakin' love this demo. It feels magical.

The speed is awesome, in the true sense of the word. It's great at knowledge and basic stuff but the output is complete junk for anything concerning new facts or slightly esoteric topics.

That is insanely fast. I had it generate a basic C FFT library that can handle multi-dimension arrays, and it was instant.

Wow, feels like Google web search in 1999.

OMFG this thing is fast.

Wow, that's instant, crazy.

I understand the appeal due to the speed

15,000 tok/s

....damn. It's very impressive notwithstanding its limitations.

It doesn’t believe it’s running on that chip, it’s arguing with me