Real-time automatic tumor segmentation for ultrasound-guided breast-conserving surgery navigation

Int J Comput Assist Radiol Surg. 2022 Sep;17(9):1663-1672. doi: 10.1007/s11548-022-02658-4. Epub 2022 May 19.

Abstract

Purpose: Ultrasound-based navigation is a promising method in breast-conserving surgery, but tumor contouring often requires a radiologist at the time of surgery. Our goal is to develop a real-time automatic neural network-based tumor contouring process for intraoperative guidance. Segmentation accuracy is evaluated by both pixel-based metrics and expert visual rating.

Methods: This retrospective study includes 7318 intraoperative ultrasound images acquired from 33 breast cancer patients, randomly split between 80:20 for training and testing. We implement a u-net architecture to label each pixel on ultrasound images as either tumor or healthy breast tissue. Quantitative metrics are calculated to evaluate the model's accuracy. Contour quality and usability are also assessed by fellowship-trained breast radiologists and surgical oncologists. Additionally, the viability of using our u-net model in an existing surgical navigation system is evaluated by measuring the segmentation frame rate.

Results: The mean dice similarity coefficient of our u-net model is 0.78, with an area under the receiver-operating characteristics curve of 0.94, sensitivity of 0.95, and specificity of 0.67. Expert visual ratings are positive, with 93% of responses rating tumor contour quality at or above 7/10, and 75% of responses rating contour quality at or above 8/10. Real-time tumor segmentation achieved a frame rate of 16 frames-per-second, sufficient for clinical use.

Conclusion: Neural networks trained with intraoperative ultrasound images provide consistent tumor segmentations that are well received by clinicians. These findings suggest that neural networks are a promising adjunct to alleviate radiologist workload as well as improving efficiency in breast-conserving surgery navigation systems.

Keywords: Artificial intelligence; Breast cancer; Breast ultrasound; Surgery navigation systems.

MeSH terms

  • Breast / diagnostic imaging
  • Breast Neoplasms* / diagnostic imaging
  • Breast Neoplasms* / surgery
  • Female
  • Humans
  • Image Processing, Computer-Assisted / methods
  • Mastectomy, Segmental*
  • Retrospective Studies
  • Ultrasonography, Interventional