Since they say that this is from an unreleased research version of Claude:
I wonder if at some point Anthropic and OpenAI will start delaying the release of their models intentionally so they can reap the benefits from the models in, for example, mathematics, medicine, physics, and other fields.
Just as an example, imagine if your model were capable of proving P = NP, or if your model could cure diseases. Would you release it for free, or would you try to make sure those benefits go directly to your company? From these companies' standpoint, I think they would choose the latter.If a company had a model that could cure cancer they would be incentivized to release the cure ASAP before they get decapitation striked by regulators and other AI "safetyists".
I think those specific examples, they'd release them publicly because the benefits to humanity are so clear -- however, if they found some new option-pricing model or futures market correlation, I highly doubt we'd see that...
Yes, I think so, inevitably. For the same reason that Bitcoin mining silicon manufacturers stopped selling the latest greatest hardware to the public.
The best way to do this is to release spooky stories about how dangerous your model is and how you couldn't possibly release it without further safety shackling.
Your comment reminds me of the TV series "Persons of interest"* (with Jim Cazeviel) from 15 years ago, there are two AIs and both run private, hidden stuff. One copies itself through every router on the planet etc. and is the "evil AI" while the good guys run, in secret, a good AI (but way less powerful then the evil one).
Now the problem ATM is that OpenAI, for example, had to cut the price of two of its top 3 models by 80% to counter the chinese models: if you delay your models and a competitors takes over the market, you'll soon be out of bucks and won't be able to rent to Google and Amazon etc. the machine needed to make your new findings.
I know people don't want to hear it but: these companies are running at a loss.
And they're facing competition. Wait until a "good enough" is etched on silicon (by AMD or other) and outputs 70 000 tokens/s: the deal is going to change, once again, once those come out.
The energy, the hardware, the debt, the cost to train, the cost to run, the competition, etc. all have to be taken into account.
>From these companies' standpoint, I think they would choose the latter.
Ever since these things came about I've wondered why they haven't been doing this the whole time. If they've got the "do-anything" robot and can scale a billion of them, why aren't they creating a Do-Everything conglomerate that disrupts every possible industry with zero/negligible labor costs?
The only answer I've come up with is that they still need to train/siphon off each industry's current expertise by having those users interact with the current models and adjusting. If that hypothesis is correct then within a few years they'll have no need for users anymore.