alt Hacker NewsWouldn't it have been more useful/conclusive if the study had another control group or two with non-AI based assistance (access to math books, access to calculator, access to human experts, etc)?
Replies
stingraycharles • yesterday at 11:32 AM
Human experts would be the best equivalent, especially if that person is great at confidently explaining things (no matter of correct or incorrect).
➕ show 1 reply
This is exactly the reason the studios garbage, and was clearly tailored to prove a point and sell books. He literally should have asked got5 or Claude how to design a useful study of the problem.
FWIW, well designed study probably would still support his premise. He at least needed a group with no help, a group with no help but books and a calculator (tools), a group with human assistance, and a group with AI assistance, and a group that does an unrelated activity during the priming period.