logoalt Hacker News

steveBK123today at 12:06 PM1 replyview on HN

I think we are entering the phase where corporate is expecting more ROI than they are getting, but want to remain in the arms race.

The firmwide AI guru at my shop who sends out weekly usage metrics and release notes started mentioning cost only in the last few weeks. At first it was just about engaging with individual business heads on setting budgets / rules and slowing the cost growth rate.

A few weeks later and he is mentioning automated cost reporting, model downgrading and circuit breaking at a per-user level. The daily spend where you immediately get locked within 24 hours is pretty low.


Replies

dranudintoday at 12:41 PM

I noticed something similar at my work. The CEO is hyping AI, but at the same time free access to the big models was taken away and rate limits seem to be much tighter..