logoalt Hacker News

zarzavat05/15/20251 replyview on HN

60/h is obviously well within normal human usage of an app and not bot traffic...

A normal rate limit to separate humans and bots would be something like 60 per minute. So it's about an order of magnitude too low.


Replies

mjevans05/15/2025

Use case: crawling possibly related files based on string search hints in a repo you know nothing about...

Something on the order of 6 seconds a page doesn't sound TOO out of human viewing range depending on how quickly things load and how fast rejects are identified.

I could see ~10 pages / min which is 600 pages / hour. I could also see the argument that a human would get tired at that rate and something closer to 200-300 / hr is reasonable.

show 1 reply