logoalt Hacker News

carlsverreyesterday at 9:13 PM1 replyview on HN

Hey, author here! Good question. The prompt was to use the Antithesis skills[1] to write a workload that exercises SQLite's insertion and checkpoint machinery across multiple processes using a specific version of SQLite (3.51.2). The agent who did the work was aware of the bug and knew I wanted to see if Antithesis could reproduce it. However, I specifically designed the workload the same way we approach testing other WAL checkpoint-style systems: by putting them under stress. The workload itself does not know about the bug.

My goal, which I believe I accomplished, was to determine if Antithesis would have found this bug if we had put the SQLite WAL under test.

[1]: https://github.com/antithesishq/antithesis-skills


Replies

minimaltomyesterday at 9:14 PM

Thanks for clarifying! It would be really interesting if Antithesis finds the bug when:

1. The specific bug isnt mentioned 2. (If youre game) a model with a knowledge-cutoff date before the report is used

show 1 reply