I had a friend who has now gotten several out of pocket MRIs essentially against medical advice because she believes her persistent headaches are from brain cancer.

Even after the first MRI essentially ruled this out, she fed the MRI to chatGPT which basically hallucinated that a small artifact of the scan was actually a missed tumor and that she needed another scan. Thousands wasted on pointless medical expenses.

Having friend's in healthcare, they have mentioned how common this is now. Someone coming in and demanding a set of tests based on chatGPT. They have explained that A, tests with false positives can actually be worse for you (triggers even more invasive tests) B, insurance won't cover any of your chatGPT requests.

Again, being involved in your care is important but disregarding the medical professional in front of you is a great way to set yourself up for substandard care.