logoalt Hacker News

thiagoperesyesterday at 10:47 PM0 repliesview on HN

We run a lot of varied, tiny, simple workflows that were previously running on 5.4-nano and mini. We transitioned them to 5.6 and noticed exactly this range of improvement across the board. In a few cases, we had improvements in classification.

I think a lot of people miss that for many companies, a model upgrade like this is basically a one liner.

Even if you have an amazing model router architecture (which we do for our golden flows), it’s just not worth it. Not to mention reliability and so on