logoalt Hacker News

fastball • today at 1:08 PM • 1 reply • view on HN

A 2s LLM call is pretty slow.

Replies

gadflyinyoureye • today at 1:22 PM

Try using Digital Ocean. Minutes spent on inference.