Two LLMs with the same numbers on important benchmarks could have vastly different behavior in actual deployment. Not sure if as hard to switch as Excel <> Libre but still not "cheap and easy".
This is just another example of the bitter lesson. In a year a model will come out that will make none of these model specific optimizations you made matter.
This is just another example of the bitter lesson. In a year a model will come out that will make none of these model specific optimizations you made matter.