It would certainly be interesting to have a highly respected EU-native inference provider, if only to make the regulatory gods happy
IONOS (1&1) also offers inference hosted in europe/germany: https://cloud.ionos.com/managed/ai-model-hub
Scaleway have two separate (one fully managed one a bit less) services for that:
agree. I have a usecase for a bigger open-weight model hosted by an EU company and the selection isnt really great, hard to make the regulatory gods (and the devs) happy at the same time right now
Never understood why hetzner gets brought up so positively here when there are dozens of EU competitors who are just as good and don't run 7 year old discounted servers
OVH already provides this → https://www.ovhcloud.com/en/public-cloud/ai-endpoints/catalo...
It works great.