Purpose: Retinopathy of prematurity (ROP) is a leading cause of childhood blindness related to oxygen exposure in premature infants. Since oxygen monitoring protocols have reduced the incidence of treatment-requiring ROP (TR-ROP), it remains unclear whether oxygen exposure remains a relevant risk factor for incident TR-ROP and aggressive ROP (A-ROP), a severe, rapidly progressing form of ROP. The purpose of this proof-of-concept study was to use electronic health record (EHR) data to evaluate early oxygen exposure as a predictive variable for developing TR-ROP and A-ROP.
Design: Retrospective cohort study.
Participants: Two hundred forty-four infants screened for ROP at a single academic center.
Methods: For each infant, oxygen saturations and fraction of inspired oxygen (FiO2) were extracted manually from the EHR until 31 weeks postmenstrual age (PMA). Cumulative minimum, maximum, and mean oxygen saturation and FiO2 were calculated on a weekly basis. Random forest models were trained with 5-fold cross-validation using gestational age (GA) and cumulative minimum FiO2 at 30 weeks PMA to identify infants who developed TR-ROP. Secondary receiver operating characteristic (ROC) curve analysis of infants with or without A-ROP was performed without cross-validation because of small numbers.
Main outcome measures: For each model, cross-validation performance for incident TR-ROP was assessed using area under the ROC curve (AUC) and area under the precision-recall curve (AUPRC) scores. For A-ROP, we calculated AUC and evaluated sensitivity and specificity at a high-sensitivity operating point.
Results: Of the 244 infants included, 33 developed TR-ROP, of which 5 developed A-ROP. For incident TR-ROP, random forest models trained on GA plus cumulative minimum FiO2 (AUC = 0.93 ± 0.06; AUPRC = 0.76 ± 0.08) were not significantly better than models trained on GA alone (AUC = 0.92 ± 0.06 [P = 0.59]; AUPRC = 0.74 ± 0.12 [P = 0.32]). Models using oxygen alone showed an AUC of 0.80 ± 0.09. ROC analysis for A-ROP found an AUC of 0.92 (95% confidence interval, 0.87-0.96).
Conclusions: Oxygen exposure can be extracted from the EHR and quantified as a risk factor for incident TR-ROP and A-ROP. Extracting quantifiable clinical features from the EHR may be useful for building risk models for multiple diseases and evaluating the complex relationships among oxygen exposure, ROP, and other sequelae of prematurity.
Keywords: A-ROP, aggressive retinopathy of prematurity; AUC, area under the receiver operating characteristic curve; AUPRC, area under the precision-recall curve; BW, birth weight; CI, confidence interval; EHR, electronic health record; Electronic health records; FiO2, fraction of inspired oxygen; GA, gestational age; Machine learning; NICU, neonatal intensive care unit; Oxygen exposure; PMA, postmenstrual age; ROC, receiver operating characteristic; ROP, retinopathy of prematurity; Retinopathy of prematurity; TR-ROP, treatment-requiring retinopathy of prematurity.
© 2021 by the American Academy of Ophthalmology.