alt Hacker NewsAI boosted homework scores, then exam scores dropped: study
Comments
Moneyshot: "The results are eye-opening. After six months, pupils using ai saw their average homework score rise by 18% across all subjects. The time they took to complete each assignment fell from an average of 64 minutes to 45. But come exam time, the same students scored 20% below their classmates who had not called on ai’s help. Homework scores once predicted exam performance; now those who score highest are, perversely, more likely to do worse in exams."
Study design: "David Stromberg of Stockholm University and Victor Lei and Wu Yanhui of the University of Hong Kong set out to fill the gap. They tracked 27,000 pupils aged 12-18 in China, where ai adoption has been fast. Around 80% reported using models such as Doubao and DeepSeek; the other 20% formed the control group."
For some of the classes my kids were in, the lessons and homework time were reversed.
Learning the material (using the text book and videos) was what they had to do at night and class time was spent working through problems or applying the material in some way.
Education sustem is not about the actual knowledge, but about training various aspects of the brain during kids development. So even memorizing literature have benefits, even though it doesn't bring any career use.
If you skip this, well your brain won't develop as much at period of life it's able to do so.
Taking a forklift to the gym increases the number on the bar, but mysteriously your gains go down.
Students seem to optimize for local maxima/short-term rewards (homework scores) at the expense of the global maximum/long-term rewards (learning).
It is stopping some of the adults I work with from learning.
In the case of some management, is causing them to unlearn, forgetting about proper review and maintenance practices.
In my professional career, my employers give me a lot more assignments than exams.
I know this study is focused in China but one thing I'd like to understand is the nuance in what kind of student is likely to always reach for ai for homework help as I think (especially in the US, can't speak for other countries) the varying powers that be that can determine the quality and type of education you can receive (does your country have means to buy textbooks per student or shared, do you have funds to give students ipads to take home or no, what sets the bar on how far curriculums can go, are teacher and faculty pay and incentives simply tied to student pass rates, etc.) and those do more in shaping what "use AI responsibly" will look like and why it's so different.
Use AI for homework, you will get it done faster and get a higher grade, and then get crushed on the exam.
The article does not relate AI usage for homework to exam score drops.
It tries to link them together with no obvious cause and effect.
The score could have dropped due to worse environment at schools or kids who were stuck at home studying online and now in physical locations could not adapt fast enough (meaning, possibly just temporary drops). We do not yet have enough metrics gathered yet.
This type of article bashing AI for the root of any problems, I find it appalling without any evidence.
It's nothing but a conjecture.
Are all of our LeetCode scores down, too? We should probably code the old fashioned way periodically to ensure we still "got it".
i’m pretty sure there’s already a correlation between technology in the classroom and worse learning outcomes
[dead]
I think we need to accept that AI causes cognitive decline, like Alzheimer's. For an Adult this may be manageable, but in a young brain, this is detrimental.
Guess what this is probably fine. AI helps people do their work on a daily basis and probably makes them memorize less things. That’s how the world is moving. You don’t need to be able to memorize something for an exam to show mastery of a topic. And we shouldn’t organize our society around memorizing things for exams.
Yeah, obviously. We also don't know how to use flint and steel to start fires any more. You wouldn't outlift a crane, why would you want to outhomework an AI? And you can't even argue that this toil is going to help in the workplace, because the workplace is now AI-native, and you can offload everything to AI.
This feels like the calculator debate all over again.
Yes, using a calculator leads to worse outcomes in your learning. But also, yes, everyone always carries a calculator on their person 24/7 these days and you'll never be as fast and as accurate as a calculator.
I think it would have been kinda cool if you could have unlocked the privilege of using a calculator in school through good grades in math class. Prove you can do what the tool can, then you get to use it. Would have also provided at least one incentive for students to get good grades in at least one class.
The kids who used AI and studied for a similar amount of time as the non-AI high performers apparently had similar (slightly higher) performance. The kids who used AI and did poorly used the AI to do the homework for them (this is what the article says).
I believe AI is basically an amplifier of bad and good. I’m cynical about the world and assume it will be used more for bad than good, but I don’t doubt some of the best people in every field will be using AI to amplify their work in good ways.