alt Hacker NewsGo ahead, use all the LLMs in the world for finding bugs! It's not different than finding bugs by fuzzing, sitting with gdb, or receiving a revelation in your dream.
But then use your own brain to understand the bug, its implications, maybe ways to fix it. Again, use whatever tools, as long as your mind forms a clear understanding, which you can operate on independent on any LLMs or whatever.
The problem with "LLM bug reports" is that the submitters run a machine tool to find something that looks like a bug, but have a poor / no idea themselves what the issue is, and whether it's really an issue. It's easy to flood maintainers with such reports. The "no AI" policy pushes the responsibility of doing proper assessment onto you, the submitter.
If you can use LLMs to produce a bug report with the quality of assessment equal or above that of a diligent qualified human bug reporter, godspeed.
Replies
Then it should be clarified.
To me "no LLMs for finding bugs" means what it means, which implicitly means "we prefer to have bugs than for you to use a LLM". It is weird, may result in worse code, but it can be justified for ideological reasons, and I mean, why not, it is your project, your rules.
In the unlikely even I contribute one day, reading this rule, I will turn off my LLMs completely and my submissions will probably have bugs that could have been avoided using a LLM based debugging pass, but that's the rule, and I won't discuss it because it is also the rule.
If the intent is to avoid flooding maintainers with bug reports, say "no LLMs for bug reporting".
I've been battling this at work where management dumps a wall of claudeslop text in to a JIRA ticket highlighting some theoretical issue and it's incredibly difficult to understand what it's actually on about. And of course you can't ask the submitter because they don't know either.
> No LLMs for finding bugs.
That's what it says, literally. I'm sorry but for a programming language project.. That's the most human slop of a policy I have seen in a long time.
Low effort, human slop.
>Again, use whatever tools, as long as your mind forms a clear understanding, which you can operate on independent on any LLMs or whatever.
that isn't what the policy says. It isn't just about writing the report.
> If you use a chatbot to give you advice on a comment on the issue tracker, that comment is unwelcome.