logoalt Hacker News

loudmaxtoday at 2:41 AM1 replyview on HN

For me it was torrenting a 7G ball of weights leaked from Meta and running alpaca.cpp (an early variant of llama.cpp) on my desktop computer in early 2023. I started asking it questions about the Roman empire and it answered me in English! The responses were generally incorrect, but no worse than what your average American college student might guess at, though delivered with much more confidence.

This was my desktop computer responding to questions in English, not some fancy server in a massive Google data center. Who cares if what it says isn't reliable? Being able to converse with my CPU in English is like having a conversation with a dog!


Replies

stogottoday at 3:01 AM

I did the same and it wa slow but realizd there was no going back. 100x improvement in three year