logoalt Hacker News

supermattyesterday at 4:50 PM1 replyview on HN

Probably naive questions:

Does that also mean that Gemini-3 (the top ranked model) loses to mistral 3 40% of the time?

Does that make Gemini 1.5x better, or mistral 2/3rd as good as Gemini, or can we not quantify the difference like that?


Replies

esafakyesterday at 4:54 PM

Yes, of course.