In Vivo Intelligent Fluorescence Endo-Microscopy by Varifocal Meta-Device and Deep Learning
Journal
Advanced science (Weinheim, Baden-Wurttemberg, Germany)
Journal Volume
11
Journal Issue
20
Start Page
Article number 2307837
Date Issued
2024-03-15
Author(s)
Chia, Yu-Hsin
Liao, Wei-Hao
Vyas, Sunil
Chu, Cheng Hung
Yamaguchi, Takeshi
Liu, Xiaoyuan
Tanaka, Takuo
Chen, Mu Ku
Tsai, Din Ping
Abstract
Endo-microscopy is crucial for real-time 3D visualization of internal tissues and subcellular structures. Conventional methods rely on axial movement of optical components for precise focus adjustment, limiting miniaturization and complicating procedures. Meta-device, composed of artificial nanostructures, is an emerging optical flat device that can freely manipulate the phase and amplitude of light. Here, an intelligent fluorescence endo-microscope is developed based on varifocal meta-lens and deep learning (DL). The breakthrough enables in vivo 3D imaging of mouse brains, where varifocal meta-lens focal length adjusts through relative rotation angle. The system offers key advantages such as invariant magnification, a large field-of-view, and optical sectioning at a maximum focal length tuning range of ≈2 mm with 3 µm lateral resolution. Using a DL network, image acquisition time and system complexity are significantly reduced, and in vivo high-resolution brain images of detailed vessels and surrounding perivascular space are clearly observed within 0.1 s (≈50 times faster). The approach will benefit various surgical procedures, such as gastrointestinal biopsies, neural imaging, brain surgery, etc.
Subjects
HiLo fluorescence imaging; deep learning; endoscopy; metalens; optical sectioning; telecentric configuration; three-dimensional imaging
Type
journal article