logoalt Hacker News

StevenWatermanyesterday at 8:17 PM4 repliesview on HN

$0.10 extra per pr review is nothing. What software company is willing to accept worse reviews and less bugs found to save 10 cents?


Replies

mooman219today at 12:10 AM

Worse seems subjective here. It seems Luna found bugs Astra did not, and vice versa. Astra had lower noise overall. I think my take away here is to use a blend of models given their different abilities to find different domains of bugs.

jstummbilligyesterday at 8:29 PM

That very much depends on how code will be written in the future, how much of it and how often it changes. If more of it will be ephemeral (kind of what agents are already doing for all sorts of tasks right now) finding ways to very cheaply check might be of high value.

(I suspect this won't be it, though. Probably something the model providers are going to bake into the models themselves.)

po1ntyesterday at 8:29 PM

Exactly this. It's still (at this time) cheaper than a developer that would most likely perform worse.

epolanskiyesterday at 10:13 PM

Unless you're detached from reality our industry is filled with billion (trillion) dollar companies shoving broken crap on prod written by MIT-bred leetcode Ninjas and it never mattered anyway because code has no value and has always been throwaway except very rare instances.