AI is definitely harmful in healthcare. Recently a major hospital chain in New York is proposing replacing radiologists with AI (https://www.beckershospitalreview.com/radiology/nyc-health-hospitals-ceo-ai-could-replace-many-radiologists/). Turns out, AI is not adept at recognizing even simple visual patterns and shapes, but through a phenomenom called “mirage”, it pretends it is, even guessing correctly at xray intepretations on par with human radiologist even when presented with NO FILM. See here: https://arxiv.org/pdf/2603.21687. From that study, the most extreme "…example, a text-only model trained without the X-ray images achieved the top score on a chest X-ray question-answering benchmark. Fortunately, some doctors are resisting the switch on the grounds of patient safety (https://www.doctorscouncil.org/news/doctors-council-response-to-comments-made-by-mitch-katz-on-ai-replacing-radiologists).

What is also interesting is Dr. Katz decribes his hospital system-ie, NYC public health) as being especially suitable for the replacement. Katz’s proposal isn’t simply “AI is better than radiologists, therefore replace them.” There is also an economic and access argument underneath it: if AI can perform some radiology work at much lower cost, a safety-net system may see it as a way to stretch scarce medical resources. But that also creates an interesting question: is it appropriate to use a population that already has fewer healthcare resources as the place where a highly consequential AI substitution is implemented?

Already, populations such as the incarcerated are seeing their therapists replaced with chatbots. Though some may not mind or even see it as preverable to dealing with a human, I see, once again, the destitute and disadvantaged being cheated with inferior and shoddy goods.

Personally, i jettisoned the healthcare complex years ago.