Endoscopic surgery relies on two-dimensional views, posing challenges for surgeons in depth perception and instrument manipulation. While Monocular Visual Simultaneous Localization and Mapping (MVSLAM) has emerged as a promising solution, its implementation in endoscopic procedures faces significant challenges due to hardware limitations, such as the use of a monocular camera and the absence of odometry sensors. This study presents BodySLAM, a robust deep learning-based MVSLAM approach that addresses these challenges through three key components: CycleVO, a novel unsupervised monocular pose estimation module; the integration of the state-of-the-art Zoe architecture for monocular depth estimation; and a 3D reconstruction module creating a coherent surgical map. The approach is rigorously evaluated using three publicly available datasets (Hamlyn, EndoSLAM, and SCARED) spanning laparoscopy, gastroscopy, and colonoscopy scenarios, and benchmarked against four state-of-the-art methods. Results demonstrate that CycleVO exhibited competitive performance with the lowest inference time among pose estimation methods, while maintaining robust generalization capabilities, whereas Zoe significantly outperformed existing algorithms for depth estimation in endoscopy. BodySLAM's strong performance across diverse endoscopic scenarios demonstrates its potential as a viable MVSLAM solution for endoscopic applications.
EndoFlow-SLAM: Real-Time Endoscopic SLAM with Flow-Constrained Gaussian Splatting
School of Advanced Technology, Xi'an Jiaotong Liverpool University(西安交通大学利物浦大学先进技术学院);School of AI and Advanced Computing, Xi'an Jiaotong Liverpool University(西安交通大学利物浦大学人工智能与高级计算学院);School of Physical Sciences, University of Liverpool(利物浦大学物理科学学院);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州))
Advancing Dense Endoscopic Reconstruction with Gaussian Splatting-driven Surface Normal-aware Tracking and Mapping
The Chinese University of Hong Kong (CUHK)(香港中文大学);CUHK Shenzhen Research Institute(香港中文大学深圳研究院);Hong Kong Institute of Science & Innovation, Chinese Academy of Sciences(中国科学院香港创新研究院);Qilu Hospital of Shandong University(山东大学齐鲁医院)
BDIS-SLAM: A lightweight CPU-based dense stereo SLAM for surgery
United Imaging Research Institute of Intelligent Imaging(联影智能影像研究院);University of Michigan(密歇根大学);University of Technology Sydney(悉尼科技大学);Imperial College London(伦敦帝国理工学院)
ORBSLAM-based Endoscope Tracking and 3D Reconstruction
ICube (UMR 7357 CNRS), Université de Strasbourg(ICube(UMR 7357 CNRS),斯特拉斯堡大学);Instituto de Investigación en Ingeniería de Aragón (I3A), Universidad de Zaragoza(阿拉贡工程研究所(I3A),萨拉戈萨大学)
The Dresden Dataset for 4D Reconstruction of Non-Rigid Abdominal Surgical Scenes
Department of Translational Surgical Oncology, National Center for Tumor Diseases (NCT), NCT/UCC Dresden, a partnership between DKFZ, Faculty of Medicine and University Hospital Carl Gustav Carus, TUD Dresden University of Technology, and Helmholtz-Zentrum Dresden-Rossendorf (HZDR), Dresden, Germany(转化外科肿瘤中心部门,肿瘤疾病国家中心(NCT),NCT/UCC德累斯顿,由DKFZ、医学院和卡尔·戈斯瓦尔德·卡尔医院、德累斯顿技术大学以及德累斯顿-罗斯恩多夫赫尔姆霍兹中心(HZDR)组成的合作机构,德累斯顿,德国);Department of Translational Surgical Oncology, NCT/UCC Dresden, Faculty of Medicine and University Hospital Carl Gustav Carus, TUD Dresden University of Technology(转化外科肿瘤中心部门,NCT/UCC德累斯顿,医学院和卡尔·戈斯瓦尔德·卡尔医院,德累斯顿技术大学);Department for Visceral, Thoracic and Vascular Surgery, Faculty of Medicine and University Hospital Carl Gustav Carus, Technische Universität Dresden(visceral、胸腔和血管外科部门,医学院和卡尔·戈斯瓦尔德·卡尔医院,德累斯顿技术大学);Centre for Tactile Internet with Human-in-the-Loop (CeTI), Technical University Dresden(人机交互触觉互联网中心(CeTI),德累斯顿技术大学);Department of Computer Science and Engineering, The Chinese University of Hong Kong(计算机科学与工程部门,香港中文大学)
SLAM based Quasi Dense Reconstruction For Minimally Invasive Surgery Scenes
IRCAD (Institut de Recherche contre les Cancers de l’Appareil Digestif)(IRCAD(消化系统癌症研究所));ICube (UMR 7357 CNRS), Université de Strasbourg(ICube(UMR 7357 CNRS),斯特拉斯堡大学);IHU, Institut Hospitalo-Universitaire(IHU,大学医院研究所);Instituto de Investigación en Ingeniería de Aragón (I3A), Universidad de Zaragoza(阿拉贡工程研究所(I3A),萨拉戈萨大学)
DualVision ArthroNav: Investigating Opportunities to Enhance Localization and Reconstruction in Image-based Arthroscopy Navigation via External Cameras
University of Arkansas(阿肯色大学);Arthrex Inc.(阿瑟克斯公司)