logoalt Hacker News

tgmatoday at 6:46 AM0 repliesview on HN

People underestimate how efficient cost/token is for beefy GPUs if you are able to batch. Unlikely for one off consumer unit to be able to compete long term.