alt Hacker NewsTwo problematic statements in this article:
1. Test pass rate is 99.98% is not good - the only acceptable rate is 100%.
2. Tests should not be quarantined or disabled. Every flaky test deserves attention.
Replies
YetAnotherNick • today at 12:13 PM
Even something as simple as docker pull fails for 0.02% of the time.
rkomorn • today at 11:11 AM
On top of 2., new tests should be stress-tested to make sure they aren't flaky so that the odds of merging them go down.
➕ show 1 reply
hristian • today at 11:34 AM
[dead]
a test pass rate of 100% is a fairy tale. maybe achievable on toy or dormant projects, but real world applications that make money are a bit more messy than that.