A professional scientist I know (tenured, professor) recruited me to set up a backtesting framework for a predictive finance model. When the results were not as they expected (this person does not work in finance and never has), they asked to see the code, then told me that claude had found a problem with the way some of the calculations were done (there was actually no problem), supplied the claude comments, and told me to change the code to match what they thought was correct. I did it anyway. Had they had more expertise in the domain (finance), they likely would have been able to leverage claude as a tool rather than inadvertently pursuing a very stupid mistake. Domain experts tend to doubt their ability to excel in other domains which is amplified by LLMs.

They suddenly act as if Claude has awarded them with a second PhD in CS. Now they know everything and everything you tell them gets filtered through Claude.

It's like "software dude thinks he can do hardware", but on steroids. They don't know what they don't know and they think they have a panacea in their hands.

Don't you know? Software is beneath them and the fiddly bits are just standing in the way of them getting their BigImportantWork™ done.