logoalt Hacker News

camgunzyesterday at 11:00 PM2 repliesview on HN

Unless this measures the entire SDLC longitudinally (like say, over a year) I'm not interested. I too can tell Claude Code to do things all day every day, but unless we have data on the defect rate it doesn't matter at all.


Replies

pgwhalentoday at 3:24 AM

I really am quite in awe of Claude Code recently, so definitely not a naysayer, but this is a really important point. It’s so easy to create code, but am I shipping that much to prod than I used to? A bit.

Obviously this highly depends on your company and your setup and risk tolerance and what not.

falcor84today at 12:36 AM

Do any of those companies collect and share data on their defect rates to give you a baseline to compare against?