logoalt Hacker News

Goz3rryesterday at 11:00 AM1 replyview on HN

My issue is that a large share of what he tests are Amazon products with alphabet soup brand names, where QA is likely nonexistent and the conclusions are often based on a sample size of N=1. Even if you wanted to buy the "winner", the exact same product may be sold under a different name a week later.

I also find his testing methodology inconsistent. In some cases he takes manufacturer specs at face value without actually verifying them, in others he goes out of his way to comprehensively measure things that don’t matter much (to me anyways), while skipping things that seem genuinely important (self-discharge of jump starter packs for example).

That said, he's doing this with his own time and money, and makes it available for free to anyone. A lot of this also comes down to personal preference in what you value in a test.


Replies

arcbyteyesterday at 11:29 AM

I’m honestly curious what drives this kind of response. You’re aiming a lot of negativity at someone who’s voluntarily spending his own time and money to do something that, until recently, simply didn’t exist at this level of detail. Yes, there are scientific limitations and fair critiques to be made—but the tone here feels less like constructive criticism and more like punishing the effort itself. That pattern is exactly what drains the internet of anything generous or experimental: people stop sharing when every imperfect attempt is met with hostility. It’s a bit like being stranded in the desert, dying of thirst, finally offered water, and rejecting it because it isn’t cold enough. You don’t have to call the work perfect to acknowledge that it’s valuable, imperfect progress rather than something deserving of contempt.

show 1 reply