arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2312.07102physics.opticscs.AIphysics.bio-phphysics.comp-ph
收藏

基于端到端深度学习的多芯光纤内窥镜免标定定量相位成像

Calibration-free quantitative phase imaging in multi-core fiber endoscopes using end-to-end deep learning

Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);School of Artificial Intelligence, OPtics and ElectroNics (iOPEN), Northwestern Polytechnical University(西北工业大学人工智能、光学与电子学院(iOPEN));TU Dresden(德累斯顿工业大学);Competence Center for Biomedical Computational Laser Systems (BIOLAS), TU Dresden(德累斯顿工业大学生物医学计算激光系统能力中心(BIOLAS))

Jiawei Sun, Bin Zhao, Dong Wang, Zhigang Wang, Jie Zhang, Nektarios Koukourakis, Juergen W. Czarske, Xuelong Li

AI总结:

针对多芯光纤定量相位成像传统算法计算慢的问题,提出基于端到端深度学习的方法,将重建时间缩至5.5ms、帧率达181fps,还构建了含5万余对图像的首个专用开源数据集,重建保真度最高达99.8%,拓展了该技术的应用场景。

摘要:

通过多芯光纤(MCFs)实现的定量相位成像(QPI)是一种新兴的体内无标记内窥镜成像模式,具有微创性。然而,传统迭代相位恢复算法的计算需求限制了其实时成像潜力。我们提出了一种基于学习的MCF相位成像方法,将相位重建时间大幅缩短至5.5 ms,可实现181 fps的视频速率成像。此外,我们引入了一套创新的光学系统,自动生成了首个专为MCF相位成像打造的开源数据集,包含50176组散斑与相位图像对。我们训练的深度神经网络(DNN)在实验中展现出稳健的相位重建性能,平均保真度最高可达99.8%。这种高效的光纤相位成像方法可拓展QPI在难以抵达区域的应用。

英文摘要:

Quantitative phase imaging (QPI) through multi-core fibers (MCFs) has been an emerging in vivo label-free endoscopic imaging modality with minimal invasiveness. However, the computational demands of conventional iterative phase retrieval algorithms have limited their real-time imaging potential. We demonstrate a learning-based MCF phase imaging method, that significantly reduced the phase reconstruction time to 5.5 ms, enabling video-rate imaging at 181 fps. Moreover, we introduce an innovative optical system that automatically generated the first open-source dataset tailored for MCF phase imaging, comprising 50,176 paired speckle and phase images. Our trained deep neural network (DNN) demonstrates robust phase reconstruction performance in experiments with a mean fidelity of up to 99.8\%. Such an efficient fiber phase imaging approach can broaden the applications of QPI in hard-to-reach areas.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑