alt Hacker NewsKeep going though. I’m definitely looking for something like this once we can get something secure we can use with proprietary and pii data.
Replies
nip • today at 10:23 AM
Thanks!
Anything you see missing in Copilot to achieve that?
Not sure if you noticed, but there's an arch-diagram in the info popup [1].
[1] https://copilot.simplepdf.com/?share=a7d00ad073c75a75d493228...
This is the canonical use case for Tinfoil: https://tinfoil.sh/inference. It provides verifiably private AI inference with frontier open source models: https://docs.tinfoil.sh/models/overview
Disclaimer I'm the cofounder, only recommending it because it's legitimately the right shape for your problem. The idea is that the model runs inside a secure enclave (using NVIDIA confidential computing), and the enclave code is open source and is verified via remote attestation upon connection: https://docs.tinfoil.sh/verification/verification-in-tinfoil