Mistral is an interesting AI company because they clearly have a contrarian business strategy to the other AI labs. They're also landing big customers in Europe for the right reasons. People dump on them because they're not benchmaxxxing which is pretty shortsighted - do you really want to be in a benchmark arms race with China, or do you want to make money and deploy sovereign AI compute in Europe?
When Apple is not racing for the frontier it's a strategy, but when it's Mistral it's a mistake.
The two companies have read the market the same.
It's always very dangerous for first movers and their investors, and the commodification of intelligence seems even more likely each time a chinese open model release. It's less exciting to do business that way, but if you're building to stand the test of time, it's wiser that way.
I don't care about benchmarks. Benchmarks show that Opus 5 is a stronger model than Fable 5 which is obviously not the case.
But I do care about capability and so far only Anthropic and, very recently with Astra, OpenAI can deliver on coding quality. And capability matters immensely. There is a world of difference between being able to do something and not being able.
I root for Mistral and hope they'll be successful, perhaps I'll buy a subscription too once they're good enough for coding aid (perhaps they are now, didn't do any test with their models recently).
First of all, they release the models' weights, perdonally I don't consider any other option as viable (no OpenAI and definitely no Anthropic, thank you).
I especially like their Vibe Chat web offer, the allowed monthly usage with a free account is incredibly generous (still have to hit a limit) and the deep research feature (5/month for free) is also valuable.
I don't know anything about the alleged regulation maxxing problems, I don't perceive them as a problem for my causal/personal usage anyway.
Realistically they will have to deploy the Chinese models or their finetuned versions though since their models are completely out of date and not competitive. Outside of maybe government contracts it will be hard to compete against Azure/AWS who promise to run their models in EU datacenters and not store any data since actual companies normally prefer frontier models with decent performance (cost/performance is pretty decent as well if you are fine with e.g. Luna which is massively better than anything Mistral can offer).
They are regulationmaxxing instead of benchmaxxing, that's my problem with them.
This is a bottom feeder mentality. Europe has enough bright people and resources to truly compete in the AI race. There is something wrong when the only selling point is that it's local.
With how they’re currently being used we might as well call them bendmarks.
Every newly released model is paraded as SOTA showing peak or near peak performance on cherry-picked bendmarks the model was either fine-tuned on, or tested under specific conditions optimal for that model.
I tried them via OpenRouter. I loved their OCR. I really disliked their code generation. It was about six months ago -- so it was a geological era ago in this world. However Mistral is legally favored in Europe. In fact from my point of view , using them presents no trouble with GDPR (I live and work in Europe). I'm NOT a lawyer but I'm a technician that define itself 'privacy savy'.
are you saying current frontier AI labs is benchmaxxxing and not because the AI model is good ?????
You crazy to think that Fable and Astra capabilities is fake
I fail to see how this is relevant with regards to areas.
Whether AI is hosted by the USA, Europe or China - they all are awful and eliminating real jobs while also driving up RAM prices etc... Why should I want to support any of these?
I also think their business model is interesting in that they can also serve Chinese models e.g GLM and fine tune them for enterprises.
which is a market Chinese labs won't get into.
they only other company they compete with is probably palantir in that regard.