Background: Research innovations inoculardisease screening, diagnosis, and management have been boosted by deep learning (DL) in the last decade. To assess historical research trends and current advances, we conducted an artifcial intelligence (AI)–human hybrid analysis of publications on DL in ophthalmology.
Methods: All DL-related articles in ophthalmology, which were published between 2012 and 2022 from Web of Science, were included. 500 high-impact articles annotated with key research information were used to fne-tune alarge language models (LLM) for reviewing medical literature and extracting information. After verifying the LLM's accuracy in extracting diseases and imaging modalities, we analyzed trend of DL in ophthalmology with 2 535 articles.
Results: Researchers using LLM for literature analysis were 70% (p= 0.000 1) faster than those who did not, while achieving comparable accuracy (97% versus 98%, p = 0.768 1). The field of DL in ophthalmology has grown 116% annually, paralleling trends of the broader DL domain. The publications focused mainly on diabetic retinopathy (p = 0.000 3), glaucoma (p = 0.001 1), and age-related macular diseases (p = 0.000 1) using retinal fundus photographs (FP, p = 0.001 5) and optical coherence tomography (OCT, p = 0.000 1). DL studies utilizing multimodal images have been growing, with FP and OCT combined being the most frequent. Among the 500 high-impact articles, laboratory studies constituted the majority at 65.3%. Notably, a discernible decline in model accuracy was observed when categorizing by study design, notwithstanding its statistical insignificance. Furthermore, 43 publicly available ocular image datasets were summarized.
Conclusion: This study has characterized the landscape of publications on DL in ophthalmology, by identifying the trends and breakthroughs among research topics and the fast-growing areas. This study provides an efcient framework for combined AI–human analysis to comprehensively assess the current status and future trends in the feld.
Background: Research innovations inoculardisease screening, diagnosis, and management have been boosted by deep learning (DL) in the last decade. To assess historical research trends and current advances, we conducted an artifcial intelligence (AI)–human hybrid analysis of publications on DL in ophthalmology.
Methods: All DL-related articles in ophthalmology, which were published between 2012 and 2022 from Web of Science, were included. 500 high-impact articles annotated with key research information were used to fne-tune alarge language models (LLM) for reviewing medical literature and extracting information. After verifying the LLM's accuracy in extracting diseases and imaging modalities, we analyzed trend of DL in ophthalmology with 2 535 articles.
Results: Researchers using LLM for literature analysis were 70% (p = 0.000 1) faster than those who did not, while achieving comparable accuracy (97% versus 98%, p = 0.768 1). The field of DL in ophthalmology has grown 116% annually, paralleling trends of the broader DL domain. The publications focused mainly on diabetic retinopathy (p = 0.000 3), glaucoma (p = 0.001 1), and age-related macular diseases (p = 0.000 1) using retinal fundus photographs (FP, p = 0.001 5) and optical coherence tomography (OCT, p = 0.000 1). DL studies utilizing multimodal images have been growing, with FP and OCT combined being the most frequent. Among the 500 high-impact articles, laboratory studies constituted the majority at 65.3%. Notably, a discernible decline in model accuracy was observed when categorizing by study design, notwithstanding its statistical insignificance. Furthermore, 43 publicly available ocular image datasets were summarized.
Conclusion: This study has characterized the landscape of publications on DL in ophthalmology, by identifying the trends and breakthroughs among research topics and the fast-growing areas. This study provides an efcient framework for combined AI–human analysis to comprehensively assess the current status and future trends in the feld.
目的:分析医学人工智能通识课程“眼科人工智能的研发与应用”的开展效果,为相关医学人工智能通识课程的开展提供参考和借鉴。方法:纵向观察性研究。观察分析2020年秋季学期眼科人工智能的研发与应用通识课程学生人群,课程考核结果以及学生对课程的整体评价。结果:共有118名本科生同学参与了课程学习。其中大部分为低年级临床医学专业本科生。期中考核得分为77.21±10.07,有56位同学(47.46%)达到80分以上。期末考核得分为82.24±6.77,有91位同学(77.12%)达到80分以上。同学对课程的评分为98.76±3.55,超过90%的同学表示课程备课认真、授课条理清晰、表达准确。结论:本课程的顺利进展证明医学人工智能联合教学模式的可行性,理论和实践穿插的教学设置帮助同学们更好地掌握知识技术,完成教学目标。
Objective: To analyze the effectiveness of medical education curriculum named “Development and Application of Ophthalmic Artificial Intelligence”, and provide reference for the development of other related curriculums. Methods: Longitudinal observational study method was adopted. During the fall semester of 2020, we conducted an education curriculum named “Development and Application of Ophthalmic Artificial Intelligence” and analyzed the results of mid-term and final examinations, and curriculum evaluation of students. Results: There were 118 undergraduate students taking the course and most of them were junior students majoring in clinical medicine. The score of the mid-term examination was in the range of 77.2±10.07, and 56 students (47.46%) got more than 80 points. The score of the final examination was in the range of 82.24±6.77, and 91 students (77.12%) got more than 80 points. The score of course evaluation of students was in the range of 98.76±3.55, and more than 90% of the students thought that teachers have made full preparations before class, together with clear teaching logic and accurate expressions in class. Conclusion: The smooth progress of our course proved the feasibility of medical artificial intelligence teaching. The teaching setting interspersed with theory and practice could help students to master knowledge and technology better, so as to achieve the teaching objectives.