logoalt Hacker News

acalvino4 • today at 1:51 PM • 2 replies • view on HN

Even before the ai age, people published inaccurate/misleading benchmarks all the time. Sometimes those were actual cheating, and other times an honest mistake. What matters is that the author acknowledges the issue and attempts to correct the mistake, which clearly seems to have happened here: https://github.com/ClickHouse/ClickBench/pull/2751

Most of this thread doesn't seem to acknowledge that, and feels more like anti-ai psychosis using this incident as an anecdote to justify the pre-existing hatred of ai-generated projects.


Replies

the__alchemist • today at 1:53 PM

I suspect the author of that PR submitted it and attempted to correct the mistake because he got caught. Forgiveness because he reneged after getting caught encourages the behavior. The project, nor author should not be trusted; otherwise is naive.

➕ show 2 replies
hmry • today at 1:54 PM

> acknowledges the issue

I don't see any acknowledgement in that text.

➕ show 1 reply