alt Hacker NewsI really think one needs a "Harvard architecture" for AIs (data independent of instructions). Though yes, that may not be possible.
Replies
It's not possible with today's LLM models, but we are not wedded to the current architecture.
I doubt it's possible, regardless of specific architecture, because if you want an AI that can do general purpose tasks like "look at my calendar and find a restaurant for the lunch meeting that the other people also like, but make sure nobody has to travel more than 20 minutes to get there, and it can't be too cold inside", then it has to ingest and understand a bunch of data to do that. The whole point is that the decision-making process is reading everything. The only "fix" is to make an AI smart enough that it can understand context for each item, which is a tall order.
RFC 3514 “evil bit” header flag to the rescue: https://www.rfc-editor.org/info/rfc3514/