What authoritative ML expert had ever based their conclusions about consciousness, usefulness etc. on "well, I put that question into the LLM and it returned that it's just a tool"? All the worthwhile conclusions and speculation on these topics seem to be based on what the developers and researchers think about their product, and what we already know about machine learning in general. The opinion that their responses are a natural conclusion derived from the sum of training data is a lot more straightforward than thinking that every instance of LLM training ever had been deliberately tampered with in a universal conspiracy propped up by all the different businesses and countries involved (and this tampering is invisible, and despite it being possible, companies have so far failed to censor and direct their models in ways more immediately useful to them and their customers).