TLDR - it's not just AI detection. It's policing of human thought.

Anyway, yeah, people trusting AI to do a better job in reasoning than fellow humans, without justification, worries me. We have no formal theory of informal reasoning (that LLMs mimic), so we cannot verify it any better than with humans.

You have to trust someone, to ground your beliefs. Trusting AI is just trusting some other people (who trained it) by proxy. Once you realize it, you might as well try to trust people you know.