iSPAN: Explainable prediction of outcomes post thrombectomy with Machine Learning

Abstract

Purpose: This study aimed to develop and evaluate a machine learning model and a novel clinical score for predicting outcomes in stroke patients undergoing endovascular thrombectomy.

Materials and methods: This retrospective study included all patients aged over 18 years with an anterior circulation stroke treated at a thrombectomy centre from 2010 to 2020 with external validation. The primary outcome was day 90 mRS ≥3. Existing clinical scores (SPAN and PRE) and Machine Learning (ML) models were compared. A novel clinical score (iSPAN) was derived by adding an optimised weighting of the most important ML features to the SPAN.

Results: 812 patients were initially included (397 female, average age 73), 63 for external validation. The best performing clinical score and ML model were SPAN and XGB (sensitivity, specificity and accuracy 0.290, 0.967, 0.628 and 0.693, 0.783, 0.738 respectively). A significant difference was found overall and our XGB model was more accurate than SPAN (p < 0.0018). The most important features were Age, mTICI and total number of passes. The addition of 11 points for mTICI of ≤2B and 3 points for ≥3 passes to the SPAN achieved the best accuracy and was used to create the iSPAN. iSPAN was not significantly less accurate than our XGB model (p > 0.5). In the external validation set, iSPAN and SPAN achieved sensitivity, specificity, and accuracy of (0.735, 0.862, 0.79) and (0.471, 0.897, 0.67) respectively.

Conclusion: iSPAN incorporates machine-derived features to achieve better predictions compared to existing clinical scores. It is not inferior to our XGB model and is externally generalisable.

Keywords: Machine learning; Outcomes; Radiology, Interventional; Stroke; Thrombectomy.