alt Hacker NewsAnd the verdict is still out on if it's going to be cheaper than employees in the long run. Maybe for companies in HCoL areas (SV/NYC), but any smaller mid-market org in a LCoL area, frontier model token spend may not end up all that cheaper when your employee salaries are $55k-$75k/year so you're mostly evaluating it as an additional force multiplier expense rather than a headcount replacer.
Replies
mwigdahl • yesterday at 8:21 PM
The fully loaded cost of employees at that salary level is likely over $100K. You may still be right on the relative expenses, but you can't just look at the top-level salary line.
➕ show 1 reply
For hosted models, there's no way to know what the real costs are. But we know what it costs to run the open models, and moore's law tells us that it's going to get cheaper, at least for the same capabilities they have today.