alt Hacker NewsWe swapped an internal system from gpt-5-mini to gpt-5.6-luna and saw no benefit but 4x cost. Sufficed to say: we swapped back to gpt-5-mini.
Replies
StilesCrisis • today at 7:16 PM
So now presumably it'd at least be roughly equal cost, or maybe a little less?
Experienced similar between 5.4-mini vs 5.6-luna in our own pipelines but after spending some time on prompt optimization and testing out various reasoning effort levels 5.6-luna was well worth it. Did you just replace model selection while keeping everything else in place or spend some time on evaling with newer prompts etc?