logoalt Hacker News

josefritzishereyesterday at 6:56 PM2 repliesview on HN

The irony is that their AI bots still hoover up all your site content regardless.


Replies

sixtyjyesterday at 7:09 PM

Two different teams, I suppose. It is quite common in such a big company.

show 1 reply
TurdF3rgusonyesterday at 8:00 PM

According to Gemini it uses the googlebot cache but it will fetch on demand when it's missing and the user asks for a summary. There are separate UAs you would need to block for those, Googlebot (search) and Google-Extended (AI summaries)