logoalt Hacker News

RedRocketFlashyesterday at 9:04 PM1 replyview on HN

What's incredible is that you have businesses paying CloudFlare to stop their content being ingested by AIs (OpenAI, Anthropic, Self-operated scrapers).

And at the same time, they're paying SEO experts to make that same content easier to be ingested by systems (Google and other Search Engines) which use it for their own AI offerings.

Are you going to be able to make your online content available to Google Search but unavailable for Google Gemini?


Replies

fragmedeyesterday at 10:26 PM

Yes. Google obeys robots.txt. Set yours to disallow Google-Extended and they won't train Gemini on it.