I think his argument is more "Could the AI solution to the prompt be somehow misaligned by exploiting a weakness in the trial process?" So an AI agent could game (lack of a better word) the process and produce something that may cure cancer, but misses something else.
Also, a large percentage of Americans were against a vaccine for COVID (which is dumb obvisouly)... so, it's not crazy to imagine people rejecting any cure made by an AI.
> Also, a large percentage of Americans were against a vaccine for COVID (which is dumb obvisouly)... so, it's not crazy to imagine people rejecting any cure made by an AI.
Plenty of people will reject all AI things, fully agree.
But you mischaracterize COVID history. People were not again a COVID vaccine, by and large. They were against a rushed vaccine. They were against a vaccine without human trials. They were reluctant to guinea pig mRNA vaccines. And they opposed forced/required vaccinations.
Those are all reasonable takes. And depending on the reasoning, I can even see being anti-AI. I think a lot of spiritual people will land there, and that belief system makes their choice logical.
And if you've seen any of the Fauci stuff recently, you'll know it wasn't dumb at all.
You're right on -- the point is an alignment point in a talk that only uses "alignment" in a completely different sense than it usually is, which is incongruent at best. It's gonna lead to a way bigger backlash among laypeople/policy makers/non-expert stakeholders than the rest of the talk will lead to new growth, combined :(
Do you think the current clinical trial process has not been gamed close to the edge of uselessness ?
Do you know about the fiasco with the Alzheimer’s drug that has collectively cost humanity hundreds of billions?
I don’t see how an indecipherable AI based cure can be more misaligned.