logoalt Hacker News

bigyabaitoday at 4:59 PM1 replyview on HN

Not if it's 5-10x slower than a remote inference server. Mac prefill latency is exhausting.


Replies

sanderjdtoday at 7:05 PM

Oh tell me more about prefill latency.

show 1 reply