logoalt Hacker News

SketchySeaBeasttoday at 4:04 PM2 repliesview on HN

Commensurate to the actual cost?


Replies

sixotoday at 4:59 PM

Certainly commensurate to the price. It's up to the companies to bring the cost under the price.

AFAICT, fears of the marginal costs of LLM inference being high are dramatically overblown. All the "water" concerns are outlandish, for one—a day of moderately heavy LLM usage consumes on the order of one glass of water, compared to a baseline consumption of 1000 glasses/day for a modern human. And the water usage of a data center is approximately the same as agriculture per acre.

show 1 reply
GorbachevyChasetoday at 7:29 PM

Compared to the fair market cost of human labor? It might be thousands of times more efficient.