> Converting complex HTML pages with navigation, ads, and JavaScript into LLM-friendly plain text is both difficult and imprecise.
Oh my god. It just occurred to me that LLMs may have a better experience “browsing the internet” than humans do.
That is so tragically depressing.
Soon we'll start having a humans.txt format to account for this
On the other hand, the requirement of stuff like this and MCP for LLMs might just bring back open APIs and stuff like RSS back to the web at large!