|
While immune to burnout, ChatGPT may
demonstrate better bedside manner than
some doctors, but medical mastery is
lacking.
|
|
ChatGPT has already proven to be a valuable supplement for patients
seeking medical information and guidance, but it does not match the
value and insight of a human physician. Don’t take it from me, though.
ChatGPT says so itself: “While I am a language model that has been
trained on a vast amount of information, I am not a licensed medical
professional and I am not capable of providing medical diagnoses,
treatments, or advice,” the chatbot wrote in response to a question from
CNN. Recently published AI research suggests that physicians can learn
from ChatGPT in areas surrounding patient communication and bedside
manner, however.
|
-
ChatGPT was evaluated against a panel of licensed health care
professionals who were each exposed to nearly 200 different
medical questions posed to a public online forum, which included
patient inquiries about medical diagnoses, need for medical
attention. On average, ChatGPT scored 21% higher than physicians
for the quality of responses and 41% more empathetic, according to
the study.
-
More recently, a comparison was made of postoperative care
instructions for eight common pediatric procedures that were
provided by ChatGPT, Google and Stanford University. Stanford
University scored higher in categories across the board, however
ChatGPT and Google were about even in terms of
understandability, both scoring better than 80%. And while ChatGPT
scored well in actionability (73%), Google responses were rated
higher (83%).
-
ChatGPT is better viewed as a support for doctors than as a guide
for patients. It’s best used “one step removed from the clinical
encounter,” in situations that are low risk to the patient, according
to Dr. David Asch.
|
Dr. David Asch, a professor of medicine and senior vice dean at the
University of Pennsylvania, states: “I think we worry about the garbage in,
garbage out problem. And because I don’t really know what’s under the
hood with ChatGPT, I worry about the amplification of misinformation. I
worry about that with any kind of search engine,” he said. “A particular
challenge with ChatGPT is it really communicates very effectively. It has
this kind of measured tone, and it communicates in a way that instills
confidence. And I’m not sure that that confidence is warranted.”
|
|