Enhanced tissue slide imaging in the complex domain via cross-explainable GAN for Fourier ptychographic microscopy

Comput Biol Med. 2024 Sep:179:108861. doi: 10.1016/j.compbiomed.2024.108861. Epub 2024 Jul 16.

Abstract

Achieving microscopy with large space-bandwidth products plays a key role in diagnostic imaging and is widely significant in the overall field of clinical practice. Among quantitative microscopy techniques, Fourier Ptychography (FP) provides a wide field of view and high-resolution images, suitable to the histopathological field, but onerous in computational terms. Artificial intelligence can be a solution in this sense. In particular, this research delves into the application of Generative Adversarial Networks (GAN) for the dual-channel complex FP image enhancement of human kidney samples. The study underscores the GANs' efficacy in promoting biological architectures in FP domain, thereby still guaranteeing high resolution and visibility of detailed microscopic structures. We demonstrate successful GAN-based enhanced reconstruction through two strategies: cross-explainability and expert survey. The cross-explainability is evaluated through the comparison of explanation maps for both real and imaginary components underlining its robustness. This comparison further shows that their interplay is pivotal for accurate reconstruction without hallucinations. Secondly, the enhanced reconstruction accuracy and effectiveness in a clinical workflow are confirmed through a two-step survey conducted with nephrologists.

Keywords: Cellular imaging; Complex domain; Explainability; Generative Adversarial Networks; Image-enhancement; Microscopy; Phase images; Ptychography.

MeSH terms

  • Fourier Analysis
  • Humans
  • Image Processing, Computer-Assisted / methods
  • Kidney / diagnostic imaging
  • Microscopy* / methods