All the labs are holding back releases now, not necessarily to play games, but to make sure alignment is right. These models are teetering on the edge of "One person can seriously damage digital infrastructure" and an event like "Teenage kid uses Claude to bring Wells Fargo to it's knees for 6 hours" would be absolutely catastrophic for the whole industry.
> Teenage kid uses Claude to bring Wells Fargo to it's knees for 6 hours" would be absolutely catastrophic for the whole industry.
It would (rightfully) be catastrophic for wells fargo. And great for the industry. If your security model relies on children not having access to things state actors can leverage, your in for a rude awakening.