logoalt Hacker News

cjyesterday at 7:49 PM0 repliesview on HN

Not having a robots.txt is fine as long as it's a 404. If it's a 403, you'll be de-indexed.

I have a feeling there's more to the story than what's in the blog post.