logoalt Hacker News

grueztoday at 3:15 AM3 repliesview on HN

>You are guaranteed to pass an Anubis challenge eventually [0]

That's a double edged sword because bots will eventually get through too, and unlike humans, their time is dirt cheap.

>Cloudflare blocks legitimate users itself sometimes [1].

I never ran into this issue despite using seemingly maximally suspicious configs like tor browser. I can't say the same for some other vendors.


Replies

inigyoutoday at 9:28 AM

The bots that are problems right now are not the ones that run Anubis challenges. There is no universal anti-bot, only ones that work at certain times.

gucci-on-fleektoday at 3:57 AM

> That's a double edged sword because bots will eventually get through too, and unlike humans, their time is dirt cheap.

Yeah, I really have no idea why Anubis works right now: residential proxies are far more expensive than compute, yet the bots seem to have no problem obtaining millions of residential IPs, but they give up on even short-ish Anubis challenges.

> I never ran into this issue despite using seemingly maximally suspicious configs like tor browser. I can't say the same for some other vendors.

Yeah, I don't like the Cloudflare challenges, but in the past 5 years I've only had it outright block me once, and that fixed itself after 15 minutes. And I use Firefox on Linux with various privacy extensions, so my browser probably appears at least moderately suspicious.

Whereas I've been trapped in impossible ReCaptcha loops quite a few times, which is still better than vague error messages that magically go away when I switch to something not running Linux. So I'll begrudgingly accept that Turnstile is the least user-hostile product on the market right now.

show 2 replies
fc417fc802today at 6:05 AM

> unlike humans, their time is dirt cheap.

On the contrary I only want to visit a few pages on a given site and have an entire laptop at my disposal. Meanwhile for bots efficiency is key. A serious scraper (ie the type of actor that actually causes material problems for site operators) is performing tens or hundreds of pages loads per second per core spread across thousands of sites. Making a single page load take even half a second of cpu time is a massive win for the site operator.