logoalt Hacker News

dannywtoday at 12:36 AM2 repliesview on HN

How do you expect the spend & COGS for free LLM inference to be funded? For users who don't want to pay, or maybe can't pay?


Replies

derektanktoday at 12:53 AM

Perhaps it’s a glib and easy thing to say, but after a teaser period, I would simply not offer free LLM inference. Agreeing to serve ads just completely re-aligns your interests away from providing the best possible user experience to something else entirely.

infinite_spintoday at 12:46 AM

From things like defense/private contracts

e.g. colleges pay for institutional subscriptions

show 1 reply