logoalt Hacker News

I wouldn't say Pangram is broken, but I would say that it's brittle

40 pointsby antigizmolast Thursday at 3:33 PM19 commentsview on HN

Response: https://substack.com/@maxspero/note/c-297953357


Comments

timperatoday at 1:49 PM

I recently tried Pangram, created an account, wrote a few lines about how my day went, and it was flagged as likely AI-assisted. It clearly doesn't work.

It's especially bad that they keep insisting that it works very well, because thousands of people will probably end up falsely accused of AI usage as a result.

show 1 reply
Catloafdevtoday at 2:29 PM

I'm not sure I'd use the term 'brittle' to describe snake oil.

embedding-shapetoday at 12:30 PM

> If I want to induce a false positive in TSA's airport scanner, I can put a gun-shaped object in my bag. If I want to induce a false positive in Waymo's stop sign detection system, I can paint my own sign and put it up on a pole.

Holy strawman-batman, not only does the founder of Pangram not have a proper response to the actual criticisms, he feels the need to completely make up very different situations to try to illustrate some completely different point... I guess good job of the founder to engage at all, as deBoer does bring up a lot of valid points and criticisms of why people really shouldn't rely on "tools" like Pangram, too bad the founder failed completely at addressing the more serious points, and instead just chose to say "Well, there will be false-positives, what can you do?".

show 2 replies
achileastoday at 12:20 PM

Can something be broken that never actually worked?

show 1 reply
650today at 2:13 PM

Adding another anecdote, but Pangram flagged an essay I wrote last week as AI-assisted when it wasn't. I take Pangram results with a grain of salt now.

phoghedtoday at 2:13 PM

Even if everyone tacitly agrees Pangram is bullshit, there’s perhaps an opportunity to evolve it into a Yelp-like racket anyway.

show 1 reply