Study validates ChatGPT 4.0 as uveitis patient resource
Seattle, Wash. — In today’s digital age, patients are increasingly turning to online resources for healthcare information as technology and the internet continue to advance. A study presented at the Association for Research in Vision and Ophthalmology’s (ARVO) 2024 Annual Meeting investigated whether ChatGPT 4.0 could be utilized as an effective uveitis patient online resource.
Saeed Mohammadi, MD, a Visiting Scholar in the laboratory of Quan Dong Nguyen, MD, MSc, FARVO, FASRS at the Byers Eye Institute, Stanford University in California, together with a team of scientists from Nepal, Singapore, South Korea and India, used Google’s recommended top eight uveitis patient educational websites in their study. They collected information from the National Health Service, Cleveland Clinic, Healthline, Mayo Clinic, National Eye Institute (NEI), WebMD, Ocular Uveitis and Immunology Foundation and the American Academy of Ophthalmology (AAO). Similar queries from those websites were submitted to ChatGPT 4.0, requesting both standard responses and simplified responses. Vitreoretinal specialists were then asked to grade all the recorded contents without prior knowledge about the source, for accuracy, comprehensiveness and personal preference. Six readability tools were used to evaluate how easily the information could be understood.
The results showed that the specialists preferred the standard ChatGPT responses, perceiving them as more comprehensive but also comparable in accuracy levels to other websites. The readability tools revealed that the standard ChatGPT responses would require a higher educational level for understanding whereas the simplified ChatGPT responses would require a lower educational level compared to the existing websites. Mohammadi commented about their study on how it is important to “[ensure] that” the “information” provided by online resources “is both accurate and accessible to individuals with varying levels of education can be challenging. ChatGPT has demonstrated its ability to provide reliable, accurate, and easily understandable information on uveitis, tailored to patients’ educational level."
- Abstract title: Evaluation of the appropriateness and readability of ChatGPT responses to patient queries on uveitis
- Presentation start/end time: Sunday, May 5, 8 – 9:15am PT
- Location: Exhibit/Poster Hall, Seattle Convention Center - Arch Building
- Posterboard number: B0686
##
The Association for Research in Vision and Ophthalmology (ARVO) is the largest eye and vision research organization in the world. Members include approximately 10,000 eye and vision researchers from over 75 countries. ARVO advances research worldwide into understanding the visual system and preventing, treating and curing its disorders. Learn more at ARVO.org.
Media contact:
Jenniffer Scherhaufer, MMC, CAE
1.240.221.2923
media@arvo.org