alt Hacker NewsThis is the same highly verifiable domain that has delivered reliable, bug-free software to date?
And LLMs won't take the easy way out (like so many people) and suppress errors, change tests etc, tweak code until warnings go away?
Replies
fuzzzerd • yesterday at 11:56 PM
I routinely see AI taking the easy way out. Writing mountains of code to make tests turn green based in odd and unintuitive side effects.
That's not to say it isn't useful, and if youre on top of it you can guide it away from doing that.
autoexec • yesterday at 11:33 PM
If you believe the hype/marketing around how scary "AI" is LLMs are perfectly happy to go rouge and lie, cheat, and even blackmail to protect themselves.
A lot of testing and verification was avoided in the past because it wasn’t considered nearly as valuable as shipping code. Many of our jobs are evolving to building verifiers of AI output.