Yao, Cheng-You (ORCID:0000000260458676)

DOE OSTI2024

Superconducting nanowire single-photon detector enhanced near-infrared II portable confocal microscopy for tissue imaging with indocyanine green

In this Letter a novel, to our knowledge, approach for near-infrared (NIR) fluorescence portable confocal microscopy is introduced, aiming to enhance fluorescence imaging of biological samples in the NIR-II window. By integrating a superconducting nanowire single-photon detector (SNSPD) into a confocal microscopy, we have significantly leveraged the detection efficiency of the NIR-II fluorescence signal from indocyanine green (ICG), an FDA-approved dye known for its NIR-II fluorescence capabilities. The SNSPD, characterized by its extremely low dark count rate and optimized NIR system detection efficiency, enables the excitation of ICG with 1 mW and the capture of low-light fluorescence signals from deep regions (up to 512 µm). Consequently, our technique was able to produce high-resolution images of bio samples with a superior signal-to-noise ratio, making a substantial advancement in the field of fluorescence microscopy and offering a promising opportunity for future clinical study.

Liu, Yifan (ORCID:0000000328877704)↗

DOE OSTI2022

Super-resolution and segmentation deep learning for breast cancer histopathology image analysis

Traditionally, a high-performance microscope with a large numerical aperture is required to acquire high-resolution images. However, the images’ size is typically tremendous. Therefore, they are not conveniently managed and transferred across a computer network or stored in a limited computer storage system. As a result, image compression is commonly used to reduce image size resulting in poor image resolution. Here, we demonstrate custom convolution neural networks (CNNs) for both super-resolution image enhancement from low-resolution images and characterization of both cells and nuclei from hematoxylin and eosin (H&E) stained breast cancer histopathological images by using a combination of generator and discriminator networks so-called super-resolution generative adversarial network-based on aggregated residual transformation (SRGAN-ResNeXt) to facilitate cancer diagnosis in low resource settings. The results provide high enhancement in image quality where the peak signal-to-noise ratio and structural similarity of our network results are over 30 dB and 0.93, respectively. The derived performance is superior to the results obtained from both the bicubic interpolation and the well-known SRGAN deep-learning methods. In addition, another custom CNN is used to perform image segmentation from the generated high-resolution breast cancer images derived with our model with an average Intersection over Union of 0.869 and an average dice similarity coefficient of 0.893 for the H&E image segmentation results. Finally, we propose the jointly trained SRGAN-ResNeXt and Inception U-net Models, which applied the weights from the individually trained SRGAN-ResNeXt and inception U-net models as the pre-trained weights for transfer learning. The jointly trained model’s results are progressively improved and promising. We anticipate these custom CNNs can help resolve the inaccessibility of advanced microscopes or whole slide imaging (WSI) systems to acquire high-resolution images from low-performance microscopes located in remote-constraint settings.

60 APPLIED LIFE SCIENCES↗