logoalt Hacker News

yla92 • yesterday at 5:56 PM • 2 replies • view on HN

The company says they did. From the post

"Orkes said they ran Jepsen’s existing Postgres test harness to find and resolve issues in ParticleDB prior to this work. However, that same test harness failed immediately when run against ParticleDB 1.1.4. Orkes also stated they tested ParticleDB with SQLancer, which generates far more complex queries than the ones we tested. It is therefore perplexing that nearly every feature we tested exhibited glaring errors, and that our findings seemed to come as a surprise."


Replies

eqvinox • yesterday at 10:59 PM

They probably asked an AI to run the tests against their DB. And the AI said "yeah I ran it, all green!" (except with a lot more words and perfect grammar, and maybe a few section headings and emoji.)

mxey • yesterday at 6:01 PM

Seems to me that “we ran the Jepsen test” is just something an LLM thought would sound good on a DB’s website.