SimCol3D -- 3D Reconstruction during Colonoscopy Challenge
University College London(伦敦大学学院);Stanford University(斯坦福大学);National University of Singapore(新加坡国立大学);University of Zaragoza(萨拉戈萨大学);University of Central Lancashire(中央兰开夏大学);Korea Advanced Institute of Science and Technology(韩国科学技术院);Intuitive Surgical(直觉外科公司)
Anita Rau, Sophia Bano, Yueming Jin, Pablo Azagra, Javier Morlana, Rawen Kader, Edward Sanderson, Bogdan J. Matuszewski, Jae Young Lee, Dong-Jae Lee, Erez Posne… 展开作者
Anita Rau, Sophia Bano, Yueming Jin, Pablo Azagra, Javier Morlana, Rawen Kader, Edward Sanderson, Bogdan J. Matuszewski, Jae Young Lee, Dong-Jae Lee, Erez Posner, Netanel Frank, Varshini Elangovan, Sista Raviteja, Zhengwen Li, Jiquan Liu, Seenivasan Lalithkumar, Mobarakol Islam, Hongliang Ren, Laurence B. Lovat, José M. M. Montiel, Danail Stoyanov
Colorectal cancer is one of the most common cancers in the world. While colonoscopy is an effective screening technique, navigating an endoscope through the colon to detect polyps is challenging. A 3D map of the observed surfaces could enhance the identification of unscreened colon tissue and serve as a training platform. However, reconstructing the colon from video footage remains difficult. Learning-based approaches hold promise as robust alternatives, but necessitate extensive datasets. Establishing a benchmark dataset, the 2022 EndoVis sub-challenge SimCol3D aimed to facilitate data-driven depth and pose prediction during colonoscopy. The challenge was hosted as part of MICCAI 2022 in Singapore. Six teams from around the world and representatives from academia and industry participated in the three sub-challenges: synthetic depth prediction, synthetic pose prediction, and real pose prediction. This paper describes the challenge, the submitted methods, and their results. We show that depth prediction from synthetic colonoscopy images is robustly solvable, while pose estimation remains an open research question.
Moving Light Adaptive Colonoscopy Reconstruction via Illumination-Attenuation-Aware 3D Gaussian Splatting
Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology(武汉光电国家研究中心,华中科技大学);School of Computer Science, Wuhan University(武汉大学计算机学院);Wuhan United Imaging Healthcare Surgical Technology Co., Ltd(武汉联影医疗手术技术有限公司)
ColonSplat: Reconstruction of Peristaltic Motion in Colonoscopy with Dynamic Gaussian Splatting
Jagiellonian University, Kraków, Poland(杰洛尼摩大学);Warsaw University of Technology, Poland(华沙技术大学);Sano Centre for Computational Medicine, Kraków, Poland(Sano计算医学中心);University of Verona, Italy(威尼斯大学);IDEAS Research Institute, Warsaw, Poland(IDEAS研究机构)
C3VDv2 -- Colonoscopy 3D video dataset with enhanced realism
Department of Biomedical Engineering, Johns Hopkins University(生物医学工程系,约翰霍普金斯大学);Division of Gastroenterology and Hepatology, Johns Hopkins Medicine(胃肠病学与肝病学分会,约翰霍普金斯医学)
ColonCrafter: A Depth Estimation Model for Colonoscopy Videos Using Diffusion Priors
Department of Biomedical Informatics, Harvard Medical School(生物医学信息学系,哈佛医学院);Center for Advanced Endoscopy, Beth Israel Deaconess Medical Center(先进内窥镜中心,贝塞斯达医院)
CoGE: Sim-to-Real Online Geometric Estimation for Monocular Colonoscopy
Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong SAR, China(香港中文大学电子工程系,香港特别行政区,中国);Shenzhen Loop Area Institute, China(深圳环湖研究所,中国)
ColonAdapter: Geometry Estimation Through Foundation Model Adaptation for Colonoscopy
School of Computer Science and Engineering, Southeast University(东南大学计算机科学与工程学院);Vetex Lab(Vetex实验室);Southeast University - Monash University Joint Graduate School(东南大学-墨尔本大学联合研究生院);Monash Suzhou Research Institute(墨尔本大学苏州研究院);Faculty of Information Technology, Monash University(墨尔本大学信息科技学院)
RealSynCol: a high-fidelity synthetic colon dataset for 3D reconstruction applications
Department of Electronics, Information, and Bioengineering, Politecnico di Milano(米兰理工大学电子、信息与生物工程系);School of Electronic and Electrical Engineering, University of Leeds(利兹大学电子与电气工程学院);Division of Gastroenterology, Vanderbilt University Medical Center(范德比尔特大学医学中心胃肠科);Department of Mechanical Engineering, Vanderbilt University(范德比尔特大学机械工程系);Endoscopy Unit, Humanitas Clinical and Research Center IRCCS(人类itas临床与研究中心内窥镜单元);Department of Biomedical Sciences, Humanitas University(人类itas大学生物医学科学系)
Gaussian Process Prior Variational Autoencoder for Endoscopic Videos
Department of Electromechanics, InViLab, University of Antwerp(安特卫普大学机电工程系InViLab实验室);Department of Computer Science, University of Manchester(曼彻斯特大学计算机科学系);Department of Electrical Engineering, Eindhoven University of Technology(埃因霍温理工大学电气工程系)
SegCol Challenge: Semantic Segmentation for Tools and Fold Edges in Colonoscopy data
UCL Hawkes Institute, University College London(伦敦大学学院霍克斯学院);Department of Computer Science, University College London(伦敦大学学院计算机科学系);Medtronic(美敦力);Department of Computer Science, University Liverpool(利物浦大学计算机科学系)
University of Bergen(卑尔根大学);SimulaMet(西穆拉梅特);Nepal Medical College(尼泊尔医学院);Kathmandu University(加德满都大学);UiT The Arctic University of Norway(挪威北极大学);University of Oslo(奥斯陆大学);Oslo Metropolitan University(奥斯陆城市大学)
Validating polyp and instrument segmentation methods in colonoscopy through Medico 2020 and MedAI 2021 Challenges
Northwestern University(西北大学);Jadavpur University(贾达普大学);Technische Universität Hamburg(汉堡工业大学);SimulaMet(西穆拉梅特研究所);Julius-Maximilian University of Würzburg(维尔茨堡大学);Australian National University(澳大利亚国立大学);Gachon University(嘉泉大学);University of Oxford(牛津大学);University of Bergen(卑尔根大学);University of Oslo(奥斯陆大学);Swedish Medical Center(瑞典医疗中心);National University of Computer and Emerging Sciences(国家计算机与新兴科学大学);University of Science, VNU-HCM(胡志明市国家大学科学大学)
EndoFinder: Online Image Retrieval for Explainable Colorectal Polyp Diagnosis
Digital Medical Research Center, School of Basic Medical Sciences, Fudan University(复旦大学基础医学院数字医学研究中心);Shanghai Institute for Advanced Study of Zhejiang University(浙江大学上海高等研究院);Endoscopy Center and Endoscopy Research Institute, Zhongshan Hospital, Fudan University(复旦大学附属中山医院内镜中心及内镜研究所);School of Computer Science and Engineering, Nanjing University of Science and Technology(南京理工大学计算机科学与工程学院);Alliance Manchester Business School, The University of Manchester(曼彻斯特大学联盟曼彻斯特商学院)