alt Hacker NewsSelf-hosting takes either cloud- or on-prem-engineering chops, which are in short supply. In my view, that becomes the primary driver for lowering token costs. Secondary are the alternative model sources like Z.ai and Moonshot, which between open weights and lower prices help to drive commoditization. But there is a political risk with these, for example, Z.al is on the U.S. Department of Commerce Entity List, which blocks American companies from selling advanced technology and goods to the firm.
Replies
you seem to be discounting or unaware of the possibility of a) automating a significant chunk of new buildouts, and b) domestic companies seeking a slice of the “sell open model hosting for less than competitors” pie.
I truly believe the cost per token for most people will eventually go approximately to zero even in the absence of subsidy unless there is a dramatic state intervention to curtail free computing and hardware R&D and manufacturing.
On macs you just install a desktop app. What can be simpler? Decent Qwen models already doing some simpler types of agentic work.