alt Hacker News> Inference is cheap
We have absolutely 0 hard proof of this. We have a lot of wishful thinking but no hard numbers, audited numbers from any public entity.
I'd love to see them if they are available.
> Inference is cheap
We have absolutely 0 hard proof of this. We have a lot of wishful thinking but no hard numbers, audited numbers from any public entity.
I'd love to see them if they are available.
Where have you looked? OpenRouter? Your own experiments? From running various models locally on my MacBook, and paying for the laptop and the electricity to power it, but not the training run, as all I did was install some software that downloaded models from Hugging Face, yes it's cheap. Well, the hardware was several thousand dollars, so not cheap on a personal level, but not unaffordable either.