logoalt Hacker News

calebhwintoday at 12:42 AM1 replyview on HN

Hard disagree.

Two LLMs with the same numbers on important benchmarks could have vastly different behavior in actual deployment. Not sure if as hard to switch as Excel <> Libre but still not "cheap and easy".


Replies

vmg12today at 2:03 AM

This is just another example of the bitter lesson. In a year a model will come out that will make none of these model specific optimizations you made matter.

show 1 reply