Have you... talked to people? Like, people generally, not domain experts using these tools to augment their existing process.

Tons of people think AI is significantly more capable than it is. We've known for the better part of a century that generating text that merely pretends competence is enough to convince a significant portion of the population that it is competence.