Improving the Diagnostic Performance and Breast Imaging Reporting and Data System Category Agreement of Less Experienced Radiologists by Utilizing Computer-Aided Diagnosis Software for Breast Ultrasound

Abstract

This study aimed to assess the effectiveness of intelligence-based computer-aided diagnosis (CAD) software in ultrasound (US) and its potential to improve the diagnostic performance of less experienced radiologists, as well as the agreement on Breast Imaging Reporting and Data System (BI-RADS) categories with the experienced radiologist. Images of 385 breast lesions in 351 female taken from January 2019 to December 2020 were included. Two less experienced radiologists independently reviewed US images with and without CAD assistance, recording final assessments using the BI-RADS category. The diagnostic performance of CAD and radiologists were calculated and compared. Kappa statistics were used to determine agreement between the experienced radiologist and the less experienced radiologists, based on BI-RADS category before and after using CAD software. The sensitivity, specificity, accuracy, positive predictive value, and negative predictive value of CAD software were 95.5%, 71.5%, 81.3%, 69.8%, and 95.9%, respectively, and those were improved in junior radiologist and intermediate-level radiologist after the addition of CAD. Additionally, with the assistance of CAD, the area under the curve was improved for both the junior radiologist and radiologist (0.704 vs 0.847 and 0.876 vs 0.900, P = 0.009, 0.005), although it remained lower than the senior radiologist. The agreement of BI-RADS category between the less experienced and the experienced radiologists showed a significant improvement (P = 0.04, 0.000). The CAD on US could improve less experienced radiologists' diagnostic performance and agreement on BI-RADS categories, making it an effective decision-making tool in clinical practice.