alt Hacker NewsI'd be all for homomorphic encryption on inference, but as you say, this is probably mostly to prevent end users from observing intermediate results.
I'd be all for homomorphic encryption on inference, but as you say, this is probably mostly to prevent end users from observing intermediate results.
Homomorphic encryption for LLMs is extremely expensive and nowhere near computationally possible for the scale of current LLMs.