logoalt Hacker News

esafak • today at 2:51 PM • 2 replies • view on HN

Look at the Intelligence Index vs. Cost per Task. Mistral 4 is not competitive. https://artificialanalysis.ai/#intelligence-efficiency-tabs


Replies

Systemerror7A69 • today at 3:24 PM

Irregardless of wether or not Mistral Large 4 is competitive or not, I do not trust the AA numbers anymore, for various reasons. Them changing their numbers around so much recently brings the entire validity of this in question, not to mention if such a combined number is even important at all. The combined "intelligence" score of AA includes areas I do not care about or need at all.