logoalt Hacker News

fc417fc802 • yesterday at 11:05 PM • 0 replies • view on HN

> AI unfortunately currently can't be e2e encrypted at scale

It can actually, there are even inference providers that offer this. It isn't strictly E2EE but running a published image on attested hardware is the next best thing. The customer can inspect the image and the hardware manufacturer attests that this is the image that the inference provider is actually running.

That said the latest generation of attested hardware is quite vulnerable (see https://tee.fail/) so you're still taking the provider at their word that they haven't intentionally compromised their own machines.