logoalt Hacker News

deweytoday at 11:52 AM0 repliesview on HN

Won’t work for any popular site. You can try that easily by using extensions to set the user agent. If you are not checking the public list of IPs that Google publishes for the crawler you are doing it wrong.