|
While immune to burnout, ChatGPT may demonstrate better bedside manner than some doctors, but medical mastery is lacking.
|
|
ChatGPT has already proven to be a valuable supplement for patients seeking medical information and guidance, but it does not match the value and insight of a human physician. Don’t take it from me, though. ChatGPT says so itself: “While I am a language model that has been trained on a vast amount of information, I am not a licensed medical professional and I am not capable of providing medical diagnoses, treatments, or advice,” the chatbot wrote in response to a question from CNN. Recently published AI research suggests that physicians can learn from ChatGPT in areas surrounding patient communication and bedside manner, however.
|
- ChatGPT was evaluated against a panel of licensed health care professionals who were each exposed to nearly 200 different medical questions posed to a public online forum, which included patient inquiries about medical diagnoses, need for medical attention. On average, ChatGPT scored 21% higher than physicians for the quality of responses and 41% more empathetic, according to the study.
- More recently, a comparison was made of postoperative care instructions for eight common pediatric procedures that were provided by ChatGPT, Google and Stanford University. Stanford University scored higher in categories across the board, however ChatGPT and Google were about even in terms of understandability, both scoring better than 80%. And while ChatGPT scored well in actionability (73%), Google responses were rated higher (83%).
- ChatGPT is better viewed as a support for doctors than as a guide for patients. It’s best used “one step removed from the clinical encounter,” in situations that are low risk to the patient, according to Dr. David Asch.
|
Dr. David Asch, a professor of medicine and senior vice dean at the University of Pennsylvania, states: “I think we worry about the garbage in, garbage out problem. And because I don’t really know what’s under the hood with ChatGPT, I worry about the amplification of misinformation. I worry about that with any kind of search engine,” he said. “A particular challenge with ChatGPT is it really communicates very effectively. It has this kind of measured tone, and it communicates in a way that instills confidence. And I’m not sure that that confidence is warranted.”
|
|