High-precision integral imaging 3D salient object detection and reconstruction with texture features based on E2E-TransGAN

Opt Express. 2024 Oct 7;32(21):36329-36343. doi: 10.1364/OE.535280.

Abstract

Under the framework of integral imaging, a high-precision 3D salient object detection and high-quality texture features reconstruction method is proposed by using the element to element-transformer and generative adversarial network (E2E-TransGAN). The proposed method fully exploits the global salient clues of the element image array to establish cross-regional element image dependency, thereby the accuracy of the salient prediction improved. Meanwhile, our proposed E2E-TransGAN algorithm stratifies the binary salient object area and the grayscale salient object edge, effectively addressing salient region prediction errors, obvious background noise, and color loss. The experimental results show that the detection accuracy of the proposed method improves to an average of 90% across various evaluation metrics. Compared with other methods, the proposed method can reconstruct 3D images with texture features, which have high values of PSNR and SSIM, at 30 and 0.95 on average, respectively. We have experimentally verified that the proposed method achieves precise 3D object salient detection and restores the detailed textures and depth information of 3D salient objects. The proposed method provides strong support for efficient and accurate medical image analysis and simplifies subsequent computer vision tasks.