logoalt Hacker News

serf • today at 12:47 AM • 1 reply • view on HN

i'm gettin between 200-320 tok/s on a 5070ti with 131k context on llamacpp and no tuning.

very nice.

I can't speak to the intelligence of it yet.

these small agentic-focused models are a lot of fun to play with if you haven't yet.


Replies

sheephess44 • today at 3:15 AM

[flagged]