Abstract
ChatGPT has demonstrated significant potential in various aspects of medicine, including its performance on licensing examinations. In this study, we systematically investigated ChatGPT's performance in Iranian medical exams and assessed the quality of the included studies using a previously published assessment checklist. The study found that ChatGPT achieved an accuracy range of 32-72% on basic science exams, 34-68.5% on pre-internship exams, and 32-84% on residency exams. Notably, its performance was generally higher when the input was provided in English compared to Persian. One study reported a 40% accuracy rate on an endodontic board exam. To establish ChatGPT as a supplementary tool in medical education and clinical practice, we suggest that dedicated guidelines and checklists are needed to ensure high-quality and consistent research in this emerging field.
Keywords
Subject
Publication details
- DOI
- 10.4103/jehp.jehp_1210_24
- Journal
- Journal of Education and Health Promotion, 13(1), 421
- Publisher
- Wolters Kluwer Medknow Publications
- Open access
- Gold open access
- License
- CC BY-NC-SA 4.0
Cite this article
APA 7
Keshtkar, A., Atighi, F., & Reihani, H. (2024). Systematic review of ChatGPT accuracy and performance in Iran’s medical licensing exams: A brief report. Journal of Education and Health Promotion, 13(1), 421. https://doi.org/10.4103/jehp.jehp_1210_24
MLA 9
Keshtkar, Alireza, et al. "Systematic review of ChatGPT accuracy and performance in Iran’s medical licensing exams: A brief report." Journal of Education and Health Promotion, vol. 13, no. 1, 2024, pp. 421. https://doi.org/10.4103/jehp.jehp_1210_24.
Chicago (author–date)
Keshtkar, Alireza, Farnaz Atighi, and Hamid Reihani. 2024. "Systematic review of ChatGPT accuracy and performance in Iran’s medical licensing exams: A brief report." Journal of Education and Health Promotion 13 (1): 421. https://doi.org/10.4103/jehp.jehp_1210_24.
Harvard
Keshtkar, A., Atighi, F. and Reihani, H. (2024) 'Systematic review of ChatGPT accuracy and performance in Iran’s medical licensing exams: A brief report', Journal of Education and Health Promotion, 13(1), pp. 421. doi:10.4103/jehp.jehp_1210_24.
Vancouver
Keshtkar A, Atighi F, Reihani H. Systematic review of ChatGPT accuracy and performance in Iran’s medical licensing exams: A brief report. Journal of Education and Health Promotion. 2024;13(1):421. doi:10.4103/jehp.jehp_1210_24
IEEE
A. Keshtkar, F. Atighi, and H. Reihani, "Systematic review of ChatGPT accuracy and performance in Iran’s medical licensing exams: A brief report," Journal of Education and Health Promotion, vol. 13, no. 1, pp. 421, 2024, doi: 10.4103/jehp.jehp_1210_24.