logoalt Hacker News

xenatoday at 3:54 PM2 repliesview on HN

Bots don't execute JavaScript or follow complicated redirects.


Replies

pwgtoday at 4:08 PM

Bots don't [currently] execute JavaScript or follow complicated redirects.

They don't now, but enough "high value to the bots" pages turning on JS or complicated redirects will simply result in the bot authors adding JS execution or redirect following so they can continue "botting" the sites they want to scrape.

It's a hole with no bottom. Each one-up on the anti-bot side will eventually be handled on the bot side.

ExpertAdvisor01today at 6:51 PM

That's not true . A lot of bots are just headless chrome instances .