Made a Ask HN, but screwed it up by editing the text.
Anyway, good ideas/tools for evaluating LLMs ? Naturally, as a Dane, I am moving away from Claude, but I’d like more than a gut feel about how much I may have given up to do so.
Just go for Qwen or Deepseek. They are both very good.
You might benefit from LMArena's Leaderboard. It does not have Danish (yet), but German and English evaluation might help: https://lmarena.ai/de/leaderboard/text/german
Openrouter.ai shows the location of providers, you can find just a few European services, but also Singaporean and Canadian. Unfortunately, I could not find a way to filter easily.