logoalt Hacker News

phdelightfulyesterday at 10:41 PM2 repliesview on HN

I just put Anubis in front of my self-hosted forge this morning because AmazonBot had helped itself to 750 GiB (!) of traffic to my public repos this month!

At least, it claimed to be AmazonBot…


Replies

Benderyesterday at 11:27 PM

Are they in this space? [1] One could map the ranges into a web daemon and rate limit them or just 'ip route add blackhole ${cidr}' each cidr block.

[1] - https://ip-ranges.amazonaws.com/ip-ranges.json

nathanmillsyesterday at 10:46 PM

Do you have a robots.txt?

show 1 reply