alt Hacker News> This has been solved already - automated testing.
This is specious reasoning. Automated tests are already the output of these specs, and specs cover way more than what you cover with code.
Framing tests as the feedback that drives design is also a baffling opinion. Without specialized prompts such as specs, you LLM agent of choice ends up either ignoring tests altogether or even changing them to fit their own baseless assumptions.
I mean, who hasn't stumbled upon the infamous "the rest of your tests go here" output in automated tests?
Replies
mattmanser • today at 7:23 AM
I've seen a few comments recently that start with:
This is specious reasoning
It's an insulting phrase and from now on I'm immediately down voting it when I see it.
➕ show 2 replies
> Automated tests are already the output of these specs, and specs cover way more than what you cover with code.
ok but how are you sure that the AI is correctly turning the spec into tests. if it makes a mistake there and then builds the code in accordance with the mistaken test you only get the Illusion of a correct implementation