logoalt Hacker News

ubjyesterday at 6:40 PM15 repliesview on HN

One of my students recently came to me with an interesting dilemma. His sister had written (without AI tools) an essay for another class, and her teacher told her that an "AI detection tool" had classified it as having been written by AI with "100% confidence". He was going to give her a zero on the assignment.

Putting aside the ludicrous confidence score, the student's question was: how could his sister convince the teacher she had actually written the essay herself? My only suggestion was for her to ask the teacher to sit down with her and have a 30-60 minute oral discussion on the essay so she could demonstrate she in fact knew the material. It's a dilemma that an increasing number of honest students will face, unfortunately.


Replies

huevosabioyesterday at 6:50 PM

When I was in college, there was a cheating scandal for the final exam where somehow people got their hands on the hardest question of the exam.

The professor noticed it (presumably via seeing poor "show your work") and gave zero points on the question to everyone. And once you went to complain about your grade, she would ask you to explain the answer there in her office and work through the problem live.

I thought it was a clever and graceful way to deal with it.

show 4 replies
vonduryesterday at 6:43 PM

I agree. Most campuses use a product called Turnitin, which was originally designed to check for plagiarism. Now they claim it can detect AI-generated content with about 80% accuracy, but I don’t think anyone here believes that.

show 3 replies
obscuretteyesterday at 8:13 PM

There have always been problems like this. I had a classmate who wrote poems and short stories since age 6. No teacher believed she wrote those herself. She became a poet, translator and writer and admitted herself later in life that she wouldn't have believed it herself.

jancsikayesterday at 8:28 PM

Seems like this could be practically addressed by teachers adopting the TSA's randomized screening. That is, roll some dice to figure out which student on a given assignment comes in either for the oral discussion or-- perhaps in higher grades-- to write the essay in realtime.

It should be way easier than TSA's goal because you don't need to stop cheaters. You instead just need to ensure that you seed skills into a minimal number of achievers so that the rest of the kids see what the real target of education looks like. Kids try their best not to learn, but when the need kicks in they learn way better spontaneously from their peers than any other method.

Of course, this all assumes an effective pre-K reading program in the first place.

show 1 reply
FloorEggyesterday at 8:47 PM

Write it in something like Google docs that tracks changes and then share the link with the revision history.

If this is insufficient, then there are tools specifically for education contexts that track student writing process.

Detecting the whole essay being copied and pasted from an outside source is trivial. Detecting artificial typing patterns is a little more tricky, but also feasible. These methods dramatically increase the effort required to get away with having AI do the work for you, which diminishes the benefit of the shortcut and influences more students to do the work themselves. It also protects the honest students from false positives.

show 1 reply
bad_haircut72yesterday at 6:54 PM

Now imagine this but its a courtroom and you're facing 25 years

show 3 replies
neomyesterday at 6:51 PM

Doesn't google docs have fairly robust edit history? If I was a student these days I'd either record my screen of me doing my homework, or at least work in google docs and share the edit history.

show 2 replies
jstummbilligyesterday at 9:45 PM

How is that a dilemma for the students? What are their supposed options?

rkagereryesterday at 8:16 PM

Guess you have to videotape or screen-record yourself writing it. Oh what a world we've created :-S.

show 2 replies
mettamageyesterday at 8:16 PM

I would screencast the whole thing and then tell my professor that we can watch a bit together.

j45yesterday at 7:04 PM

Easy if one of these options might be available to the writer:

- Write it in google docs, and share the edit history in the google docs, it is date and time stamped.

- Make a video of writing it in the google docs tab.

If this is available, and sufficient, I would pursue a written apology to remind the future detectors.

Edit: clarity

johanamyesterday at 6:55 PM

edit history in Google docs is a good way to defend yourself from AI tool use accusations

show 1 reply
hiddencostyesterday at 6:57 PM

I seriously think the people selling AI detection tools to teachers should be sued into the ground by a coalition of state attorneys general, and that the tools should be banned in schools.