内窥镜胶囊机器人的无监督测距和深度学习
Unsupervised Odometry and Depth Learning for Endoscopic Capsule Robots
摘要:
在过去的十年中,许多医疗公司和研究小组试图将被动胶囊内窥镜作为一种新兴的微创诊断技术转换为主动可控的内窥镜胶囊机器人,这将提供更直观的疾病检测,靶向药物输送和胃肠道(GI)中的活检样操作。在这项研究中,我们介绍了一个完全无监督,实时测距和深度学习单眼内窥镜胶囊机器人。我们通过扭曲视图序列并将重投影最小化分配给损失函数来建立监督,我们在多视图姿态估计和单视图深度估计网络中采用该监督。在非刚性变形的离体猪胃数据集上进行的详细的定量和定性分析证明了该方法在运动估计和深度恢复方面的有效性。
英文摘要:
In the last decade, many medical companies and research groups have tried to convert passive capsule endoscopes as an emerging and minimally invasive diagnostic technology into actively steerable endoscopic capsule robots which will provide more intuitive disease detection, targeted drug delivery and biopsy-like operations in the gastrointestinal(GI) tract. In this study, we introduce a fully unsupervised, real-time odometry and depth learner for monocular endoscopic capsule robots. We establish the supervision by warping view sequences and assigning the re-projection minimization to the loss function, which we adopt in multi-view pose estimation and single-view depth estimation network. Detailed quantitative and qualitative analyses of the proposed framework performed on non-rigidly deformable ex-vivo porcine stomach datasets proves the effectiveness of the method in terms of motion estimation and depth recovery.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。