logoalt Hacker News

fragmedetoday at 2:45 AM1 replyview on HN

Where have you looked? OpenRouter? Your own experiments? From running various models locally on my MacBook, and paying for the laptop and the electricity to power it, but not the training run, as all I did was install some software that downloaded models from Hugging Face, yes it's cheap. Well, the hardware was several thousand dollars, so not cheap on a personal level, but not unaffordable either.


Replies

obliotoday at 2:49 AM

> OpenRouter

Do we have the balance sheet for OpenRouter & co?

Especially in this age where if you put AI in your company's mission statement you're drowned in money.

Let's hold off on calling something "cheap" until the external financing money runs out and the actual numbers are revealed AND audited.

> yes it's cheap.

When running toy models that do basically 0 of what regular people expect from state of the art LLMs, sure.

Running Apache is cheap. Running Google search isn't. They both serve web pages.

show 2 replies