Just because the hardware and inference costs may decrease in the future doesn't mean prices will. The AI vendor market is the furthest thing from a competitive industry where there are limited barriers to entry and new market entrants exert downward pressure on prices and profit margins.

Every single company in this market is losing billions on this business, and the only way to make it back is to acquire paying customers at a loss and jack up prices later.

RAM:

2024: $315

2025: $780

2026: $1600

this is not how it's going to go if OpenAI and Anthropic get their way and the US outlaws use of open-weight models

Hopefully!