logoalt Hacker News

jszymborski • today at 12:20 AM • 3 replies • view on HN

My trouble with Pangram is that the calibration is totally off. It can tell you if there is a drop or an ocean of AI in the text you submit. The "X% of AI" message doesn't really mean much. You can test this yourself: Slowly add generated text to a human write paragraph and you'll see it hit "100% AI" quite quickly.


Replies

Matticus_Rex • today at 12:58 AM

It analyzes in segments, and the percentage is of the segments, not of the words.

➕ show 1 reply
jrhizor • today at 12:44 AM

Good?

Alpha3031 • today at 1:44 AM

I don't really know why you would expect a "X% chance of containing AI" number to rise slowly or smoothly alongside the percentage of text that has a 100% chance of containing AI.

➕ show 1 reply