logoalt Hacker News

Show HN: Bullshit Detector – agent skills that fact-check videos and articles

54 pointsby skorniienkotoday at 12:58 PM58 commentsview on HN

Comments

mysterydiptoday at 1:49 PM

What do you use as “ground truth”? The page says “independent sources”, and I’m sure there’s too many to list, but my question is how are they vetted as being truthful and how are two sources with opposite viewpoints reconciled?

show 3 replies
egeozcantoday at 2:18 PM

Can someone please use this skill against the claims in its own repo?

show 1 reply
alealvarezargtoday at 2:47 PM

I think this would have a much bigger impact as short-form video content such as TikTok, Reels or Shorts. That's where most people consume this kind of content today, not in a .md file.

What would really set it apart is adding fact-checking before publishing and letting it post directly to TikTok. That combination would make it something I'd actually use every day.

show 1 reply
h2aichattoday at 2:43 PM

I like the idea! How can you let folks know they're being fed nonsense before they even finish the intro?

show 1 reply
N_Lenstoday at 1:52 PM

Who checks the checkers?

show 2 replies
leobgtoday at 2:30 PM

I don't even watch most videos anymore. YouTube app -> Share -> Gemini -> Summary. Only if that shows interesting content do I actually watch.

show 1 reply
cawingcrowtoday at 1:38 PM

That's too much effort. Should have been a browser extension that uses ollama so it can run with local models or maybe even openrouter...

show 2 replies
outimetoday at 1:52 PM

The author is posting comments here (all flagged at this time) that are very clearly AI slop, which is quite ironic.

show 1 reply
madmaniaktoday at 2:58 PM

For truth checking actual thinking and logic is required. It doesn't seem to be a proper tool for the task.

show 1 reply
ameliustoday at 2:22 PM

Funny, I recently pasted output from Gemini into Claude, and it said it was total nonsense generated by an overconfident AI.

Apparently the "AI-generated bullshit" detection is already part of LLMs.

show 1 reply
khalictoday at 1:44 PM

Awesome idea

show 1 reply
lynx97today at 2:19 PM

> Long output? Redirect to a file and read it from there:

Hmm, smells AI generated. Why should an LLM (this is from a SKILL.md) care about $LINES?

show 1 reply
quard8today at 2:33 PM

nice! my built-in BS detector: "comment "prompt" and i will send you a guide".

show 1 reply
ck2today at 2:07 PM

Washington Post gave up tracking Trump lies last term in 2021 because it became impossible by human hands with 21+ per day and over 30,000 in their database

but with "AI" now it's possible not only to do non-stop but in REALTIME

you could even just restrict the source of the check to the paper's own reporting the past fifty years

* https://www.washingtonpost.com/graphics/politics/trump-claim...

I'd like to see that backfilled, all the way back to the "long form birth certificate" (remember that horror show)

show 1 reply
o10449366today at 2:35 PM

god i wish these low effort projects were banned from Show HN

the entire premise of a "bullshit detector" that's entirely vibe-coded is laughable

show 1 reply
receptopalaktoday at 1:58 PM

[flagged]

skorniienkotoday at 1:39 PM

[flagged]

skorniienkotoday at 12:58 PM

[flagged]