People will use something for search and something needs to index pages, either for LLM or old school search engine.