logoalt Hacker News

simonwyesterday at 12:04 PM1 replyview on HN

Training costs are fixed. Inference costs are variable. The difference matters.


Replies

vrighteryesterday at 2:08 PM

No they are not. They are exponentially increasing. Due to the exponential scaling needed for linear gain. Otherwise they'd fall behind their competition.

show 1 reply