logoalt Hacker News

cortesofttoday at 12:50 AM1 replyview on HN

It would be really hard to properly account for the training, since that won't scale with more generation.

The training is already done when you make a generative query. No matter how many consumers there are, the cost for training is fixed.


Replies

nospicetoday at 12:58 AM

My point is that it isn't, not really. Usage begets more training, and this will likely continue for many years. So it's not a vanishing fixed cost, but pretty much just an ongoing expenditure associated with LLMs.

show 1 reply