arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.03078cs.CVcs.AIcs.RO
收藏

BodySLAM:面向手术应用的一种广义单目视觉SLAM框架

BodySLAM: A Generalized Monocular Visual SLAM Framework for Surgical Applications

Università Campus Bio-Medico di Roma(罗马生物医学大学校园大学);Fondazione Policlinico Universitario Campus Bio-Medico(生物医学大学校园大学附属医院基金会)

G. Manni, C. Lauretti, F. Prata, R. Papalia, L. Zollo, P. Soda

AI总结:

BodySLAM提出一种基于深度学习的单目视觉SLAM框架,通过无监督位姿估计CycleVO、Zoe深度估计和3D重建模块,在多个内窥镜数据集上实现高效稳健的定位与建图。

摘要:

内窥镜手术依赖二维视图,给外科医生在深度感知和器械操作方面带来了挑战。尽管单目视觉同时定位与建图(MVSLAM)已成为一种有前景的解决方案,但由于硬件限制(例如使用单目相机和缺少里程计传感器),其在内窥镜手术中的应用面临重大挑战。本研究提出了BodySLAM,一种基于深度学习的稳健MVSLAM方法,通过三个关键组件解决这些挑战:CycleVO,一种新颖的无监督单目位姿估计模块;集成最先进的Zoe架构用于单目深度估计;以及一个创建连贯手术地图的3D重建模块。该方法使用三个公开数据集(Hamlyn、EndoSLAM和SCARED)进行了严格评估,这些数据集涵盖腹腔镜、胃镜和结肠镜场景,并与四种最先进的方法进行了基准比较。结果表明,CycleVO在位姿估计方法中表现出具有竞争力的性能,推理时间最低,同时保持了强大的泛化能力,而Zoe在深度估计方面显著优于现有的内窥镜算法。BodySLAM在不同内窥镜场景中的强劲表现证明了其作为内窥镜应用可行MVSLAM解决方案的潜力。

英文摘要:

Endoscopic surgery relies on two-dimensional views, posing challenges for surgeons in depth perception and instrument manipulation. While Monocular Visual Simultaneous Localization and Mapping (MVSLAM) has emerged as a promising solution, its implementation in endoscopic procedures faces significant challenges due to hardware limitations, such as the use of a monocular camera and the absence of odometry sensors. This study presents BodySLAM, a robust deep learning-based MVSLAM approach that addresses these challenges through three key components: CycleVO, a novel unsupervised monocular pose estimation module; the integration of the state-of-the-art Zoe architecture for monocular depth estimation; and a 3D reconstruction module creating a coherent surgical map. The approach is rigorously evaluated using three publicly available datasets (Hamlyn, EndoSLAM, and SCARED) spanning laparoscopy, gastroscopy, and colonoscopy scenarios, and benchmarked against four state-of-the-art methods. Results demonstrate that CycleVO exhibited competitive performance with the lowest inference time among pose estimation methods, while maintaining robust generalization capabilities, whereas Zoe significantly outperformed existing algorithms for depth estimation in endoscopy. BodySLAM's strong performance across diverse endoscopic scenarios demonstrates its potential as a viable MVSLAM solution for endoscopic applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑