logoalt Hacker News

janalsncmyesterday at 8:39 PM1 replyview on HN

Intuitively, your savings depend heavily on how hard the tasks are in the first place. If you have a base rate where 99% of your tasks can be routed to a cheap model, yeah, you can save a ton by not using Fable for that.

So “1/3 the cost” really depends.


Replies

seizethecheeseyesterday at 10:25 PM

Sometimes expensive models are cheaper on easier tasks because they use fewer tokens, too.

show 1 reply