For me, the scary moment was seeing Grokipedia show up as one of the “sources” in a random Claude query a few days ago. Even if people don’t explicitly choose to use it, poisoning the well is working.
Yeah I would love it if I could put in some guardrails for this type of stuff, eg never use Grokipedia or Reddit as authoritative sources (I currently put that in my personalization prompt).
Yeah I would love it if I could put in some guardrails for this type of stuff, eg never use Grokipedia or Reddit as authoritative sources (I currently put that in my personalization prompt).