alt Hacker NewsIndeed, I've got a site which gets a lot of bot traffic and google bot is pretty sensible compared to a lot of other mainstream bots.
Indeed, I've got a site which gets a lot of bot traffic and google bot is pretty sensible compared to a lot of other mainstream bots.
Yes, it really does not make that many requests. In fact lots of site owners struggle with having it not crawl and index their site enough