This study aimed to evaluate the image quality assessment (IQA) and quality criteria employed in publicly available datasets for diabetic retinopathy (DR). A literature search strategy was used to identify relevant datasets, and 20 datasets were included in the analysis. Out of these, 12 datasets mentioned performing IQA, but only eight specified the quality criteria used. The reported quality criteria varied widely across datasets, and accessing the information was often challenging. The findings highlight the importance of IQA for AI model development while emphasizing the need for clear and accessible reporting of IQA information. The study suggests that automated quality assessments can be a valid alternative to manual labeling and emphasizes the importance of establishing quality standards based on population characteristics, clinical use, and research purposes. In conclusion, image quality assessment is important for AI model development; however, strict data quality standards must not limit data sharing. Given the importance of IQA for developing, validating, and implementing deep learning (DL) algorithms, it's recommended that this information be reported in a clear, specific, and accessible way whenever possible. Automated quality assessments are a valid alternative to the traditional manual labeling process, and quality standards should be determined according to population characteristics, clinical use, and research purpose.
摘要: 本研究旨在评估糖尿病视网膜病变 (DR) 公开数据集中的图像质量评估 (IQA) 和质量标准。使用文献检索识别相关数据集, 纳入分析20个数据集。其中, 12个数据集提到执行IQA, 但只有8个数据集明确了所用的质量标准。所报告的图像质量标准因数据集而异, 获取信息往往具有挑战性。研究结果强调了IQA对人工智能模型开发的重要性, 同时强调了明确和可访问IQA信息报告的必要性。研究表明, 自动化的图像质量评估可以有效替代手动标签的方法, 并强调建立基于人口特征、临床使用和研究目的制定质量标准的重要性。总之, 图像质量评估对人工智能模型的开发非常重要, 然而, 严格的数据质量标准不能限制数据共享。鉴于IQA对于开发、验证和实现深度学习(DL)算法的重要性, 建议尽可能以清晰、具体和可访问的方式报告这些信息。自动化质量评估是传统手工标记过程的有效替代方案, 质量标准应根据人口特征、临床应用和研究目的来确定。.
© 2023. The Author(s), under exclusive licence to The Royal College of Ophthalmologists.