alt Hacker News> done by my clankers or clankers of other people
I'm getting so many requests to review LLM-generated documents - planning docs, docs intended for end-users, project docs, business plan docs. A team member sent me a zip file with about 30 LLM generated documents in it the other day and asked if I could review them right away. And a lot of it was just repetition and/or stuff that was just out of left field, made-up, hallucinated stuff. They're able to generate this stuff way faster than we can review. It used to be that it would take a significant part of a day for a project manager to come up with a planning doc - now they can generate one in a few minutes and send it out for review. It's just really tiring.
Replies
> now they can generate one in a few minutes and send it out for review.
I think we will very soon move to a prove to me you've read it protocol and/or introduce speed bumps to slow things down.
Thats gonna be a no from me dog. I don’t expect anyone to read something I didn’t read myself
Yeah I heard a similar thing recently at a presentation. At that point wouldn't it be easier to just send the prompt around?
Write an LLM script to review them. Tell it to find at least three severe issues. Set to auto-reply.
He who brings the slop cannon shall be drowned by slop rain.
Rate of generation/Rate of verification is a proxy for signal to noise ratios, just for work.
That ratio has changed, and verification is the hard part.
Verification is the point of all markets (and a decent part of human civ as well).
And review isn’t cost less - https://en.wikipedia.org/wiki/Ironies_of_Automation
Wait, what? I thought everyone agrees that modern models post September 2025 (or whenever Opus or whatever 5.6789 was released) do not hallucinate, make things up, contradict themselves and can review their own output into perfection regardless of task, goal or context???? /s
Feed it into an AI and ask it to adversarially criticize it, doc for doc, send back 30 responses in a zip folder, wipe hands on pants, return to HN.