logoalt Hacker News

michaelbuckbeetoday at 10:51 AM4 repliesview on HN

I ran a quick eval to see what this looks like qualitatively vs just calling Opus 4.7 or GPT 5.5 directly.

As expected, Fusion was 7x slower and 4x the cost.

This isn't a knock against it, just that it I think this places Fusion into a "use it only when you need it" category.

https://3fpi5avcqq.evvl.io/


Replies

nielsoletoday at 11:26 AM

Sounds like fusion would be a really good distillation target?

IanCaltoday at 11:07 AM

Which models were you using under this? If you used the quality default as exists in the interface, it makes sense that it was ~4x the cost as it'd be 3 frontier models judged by one of those.

The idea would be to use fusion with simpler, cheaper models.

galsapirtoday at 11:42 AM

yeah its really counterintuitive i think; i.e, getting the right framework and structure for this to work probably isn't trivial, models really hate playing well together. i wonder how their version would fair in real world use.

jimmypktoday at 1:02 PM

[flagged]