logoalt Hacker News

friendly_chap • today at 7:13 AM • 1 reply • view on HN

This is a great idea but I'm far less concerned about output token speed and way more about the ability to parallelize prefill - for agentic coding that's pretty much way more important than output speed.


Replies

mohsinakram • today at 11:13 AM

[flagged]