alt Hacker NewsI wonder if there would be an equivalent of Non proliferation treaty like Nukes?
I know it sounds crazy - but if there's even 0.1% chance that some models are so good that they can be used to hack into people's bank accounts - I, as the government, would not want that model to be publicly accessible. I would also request other countries to come to the table and sign this NPT(for AI).
Public will still have access to smaller models (like guns etc) up to Opus 4.8 etc but anything bigger than that is sooo good that it's dangerous. Nuclear also has benefits but the governments consider the worst when making policies rather than the best.
I am not touting Mythos as the god model but I wonder if the policy will move in this direction.
Replies
I'm sure many countries have learnt lessons from the NPT and would have the good sense to not agree to the same thing again. We've seen time and time again if you have nukes you can do what you want to the countries without them.
I'm pretty sure the days of any government signing any NPT with the US are very over. The trust is broken. I'd rather my government stockpile all the weapons of every sort at this point.
Bank accounts are currently regularly ""hacked"" by phish and other types of fraud. Current models are capable of helping with that.
Then there's monstrously stupid stuff like https://www.visa.com/en-us/solutions/intelligent-commerce , where visa place an AI inside the security boundary, pre-hacked for anyone who can prompt injection it.