alt Hacker NewsI think the main problem with that is the main problem with a lot of security tools. In order to do useful work, you need to provide a lot of tools and permissions.
I.e. in theory the most secure might be a virtual machine with no network access. But then how do you access the LLM provider? Etc.
Replies
masterj • today at 6:56 PM
I suspect capability models are going to get more popular https://en.wikipedia.org/wiki/Capability-based_security
➕ show 1 reply
47635274172635 • today at 6:58 PM
Invent new protocol just for LLM?
tantalor • today at 6:57 PM
If "LLM provider" is part of the conversation, then you have already have ceded the security question.
> But then how do you access the LLM provider? Etc.
You can expose an HTTP proxy over a vsock into the VM.