TY - JOUR
T1 - Accelerating multicolor spectroscopic single-molecule localization microscopy using deep learning
AU - Gaire, Sunil Kumar
AU - Zhang, Yang
AU - Li, Hongyu
AU - Yu, Ray
AU - Zhang, Hao F.
AU - Ying, Leslie
N1 - Funding Information:
Directorate for Engineering (CBET-1604531, CBET-1706642, EFMA-1830969); National Institutes of Health (R01EY026078, R01EY029121).
Publisher Copyright:
© 2020 Optical Society of America under the terms of the OSA Open Access Publishing Agreement.
PY - 2020/5/1
Y1 - 2020/5/1
N2 - Spectroscopic single-molecule localization microscopy (sSMLM) simultaneously provides spatial localization and spectral information of individual single-molecules emission, offering multicolor super-resolution imaging of multiple molecules in a single sample with the nanoscopic resolution. However, this technique is limited by the requirements of acquiring a large number of frames to reconstruct a super-resolution image. In addition, multicolor sSMLM imaging suffers from spectral cross-talk while using multiple dyes with relatively broad spectral bands that produce cross-color contamination. Here, we present a computational strategy to accelerate multicolor sSMLM imaging. Our method uses deep convolution neural networks to reconstruct high-density multicolor super-resolution images from low-density, contaminated multicolor images rendered using sSMLM datasets with much fewer frames, without compromising spatial resolution. High-quality, super-resolution images are reconstructed using up to 8-fold fewer frames than usually needed. Thus, our technique generates multicolor super-resolution images within a much shorter time, without any changes in the existing sSMLM hardware system. Two-color and three-color sSMLM experimental results demonstrate superior reconstructions of tubulin/mitochondria, peroxisome/mitochondria, and tubulin/mitochondria/peroxisome in fixed COS-7 and U2-OS cells with a significant reduction in acquisition time.
AB - Spectroscopic single-molecule localization microscopy (sSMLM) simultaneously provides spatial localization and spectral information of individual single-molecules emission, offering multicolor super-resolution imaging of multiple molecules in a single sample with the nanoscopic resolution. However, this technique is limited by the requirements of acquiring a large number of frames to reconstruct a super-resolution image. In addition, multicolor sSMLM imaging suffers from spectral cross-talk while using multiple dyes with relatively broad spectral bands that produce cross-color contamination. Here, we present a computational strategy to accelerate multicolor sSMLM imaging. Our method uses deep convolution neural networks to reconstruct high-density multicolor super-resolution images from low-density, contaminated multicolor images rendered using sSMLM datasets with much fewer frames, without compromising spatial resolution. High-quality, super-resolution images are reconstructed using up to 8-fold fewer frames than usually needed. Thus, our technique generates multicolor super-resolution images within a much shorter time, without any changes in the existing sSMLM hardware system. Two-color and three-color sSMLM experimental results demonstrate superior reconstructions of tubulin/mitochondria, peroxisome/mitochondria, and tubulin/mitochondria/peroxisome in fixed COS-7 and U2-OS cells with a significant reduction in acquisition time.
UR - http://www.scopus.com/inward/record.url?scp=85084676204&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85084676204&partnerID=8YFLogxK
U2 - 10.1364/BOE.391806
DO - 10.1364/BOE.391806
M3 - Article
C2 - 32499954
AN - SCOPUS:85084676204
SN - 2156-7085
VL - 11
SP - 2705
EP - 2721
JO - Biomedical Optics Express
JF - Biomedical Optics Express
IS - 5
ER -