logoalt Hacker News

alecbztoday at 7:48 PM5 repliesview on HN

We have LLMs try to generate descriptions of PRs for us and they're pretty universally disliked. They're always overly-complex descriptions of the mechanical changes and have no sense of motivation.

Also, a huge reason to understand the code yourself is to make sure the LLM isn't wrong, but this doesn't work if an LLM is itself generating the understanding.


Replies

storustoday at 8:50 PM

My main gripe is with Claude deciding to make 200 lines of code in a PR I need to review, instead of 3 lines of code somebody who understands the original algorithm/intent would do. And coworkers just YOLOing changes without understanding them. Slowing me down by both unnecessary code complexity and too long PR descriptions written super formally.

dylan604today at 8:10 PM

Are these generated descriptions of LLM submitted changes or of human changes? If a human, shouldn't they be putting the motivation into the PR?

show 1 reply
vjvjvjvjghvtoday at 7:52 PM

I don’t know. From my experience I get pretty good descriptions of PRs if I ask the right questions and provide some context.

show 1 reply
morkalorktoday at 7:59 PM

I am so very tired of 2 page long PR descriptions for a 5 line change.

show 1 reply
avaertoday at 8:29 PM

Maybe on your team, but I don't think AI PRs are universally disliked. The people that submit PRs without understanding them are universally disliked.

Have you tried writing in AGENTS.md or whatever to exactly explain what you like/dislike about the PR descriptions?

show 2 replies