Summary
Physicians use LLMs (Large Language Models) like ChatGPT to ask multiple response questions regarding medical information. ChatGPT was used to take an examination in medical biochemistry and was able to outperform almost all the students by scoring 140 marks out of 200. It performed very well in information-based multiple choice questions (92%) and descriptive logical reasoning questions (80%). However, it scored poorly in descriptive clinical scenario-based questions (52%). ChatGPT took significantly more time to answer logical reasoning questions compared to simple information-based questions. A total of 79 questions including 40 MCQs and 39 subjective questions were asked and ChatGPT was able to demonstrate its ability to provide medical information. Physicians use information provided by ChatGPT to make management decisions thereby improving quality of care and patient outcomes. Integration of LLMs like ChatGPT into physician workflows is challenging but has the potential to change management in some cases based on information provided. Physicians report that training provided on data sources and availability of ChatGPT is adequate but they continue to make significant errors regarding the data and members available through ChatGPT. LLMs have the potential to positively impact patient care by providing quick access to relevant medical information that aids in clinical decision making. MEDLINE and online journals were found to be frequently used information resources by physicians to seek answers to questions related to patient care. While physicians use multiple information resources, libraries and librarians continue to play an important role in providing access and supporting the use of these resources. A study of gastroenterologists and general surgeons found that for conditions like hyperplastic polyps, small adenomas and larger adenomas, physicians recommended colonoscopy at frequencies greater than recommended by guidelines. This overuse of colonoscopy threatens healthcare resources. Guidelines aim to increase effectiveness of screening programs through appropriate use of resources. In summary, LLMs show potential for improving physician access to medical information and aiding in clinical decisions. However, they need to be better integrated into physician workflows. Physicians continue to rely on multiple information resources to provide patient care and libraries play an important role in access and support of these resources. Recommendations for surveillance colonoscopy frequently exceed guidelines threatening healthcare resources. Following guidelines can help optimize resource utilization.
ChatGPT scored 140 marks out of 200 and ranked fifth in the class, performing well in information and logical reasoning MCQs but poorly in clinical scenarios.
Published By:
Abhra Ghosh - Cureus
2023
Cited By:
1
Physicians recommended more frequent colonoscopy surveillance than guidelines for various polyps and adenomas; overuse threatens resources.
Published By:
P. Mysliwiec - Annals of Internal Medicine
2004
Cited By:
341
Emergency physicians using a health information exchange report it affecting some patient care. Training on the exchange needs improvement.
Published By:
N. Genes - Applied Clinical Informatics
2011
Cited By:
21
The summary in two sentences is: Libraries provide most resources cited by faculty, though some gaps remain. MEDLINE and online journals are most used by health professionals seeking patient care answers. The summary has 98 characters and is short as instructed.
Published By:
Gregg A. Steven - undefined
2021
Cited By:
0