Surgical Visual Domain Adaptation: Results from the MICCAI 2020 SurgVisDom Challenge
Intuitive, Inc.（直观医疗公司）；Konica Minolta, Inc.（柯尼卡美能达公司）；University College London（伦敦大学学院）；University of Genoa（热那亚大学）；University of Burgundy（勃艮第大学）；German Cancer Research Center (DKFZ)（德国癌症研究中心）；National Center for Tumor Diseases (NCT)（国家肿瘤疾病中心）
Aneeq Zia, Kiran Bhattacharyya, Xi Liu, Ziheng Wang, Satoshi Kondo, Emanuele Colleoni, Beatrice van Amsterdam, Razeen Hussain, Raabid Hussain, Lena Maier-Hein, … 展开作者
Aneeq Zia, Kiran Bhattacharyya, Xi Liu, Ziheng Wang, Satoshi Kondo, Emanuele Colleoni, Beatrice van Amsterdam, Razeen Hussain, Raabid Hussain, Lena Maier-Hein, Danail Stoyanov, Stefanie Speidel, Anthony Jarc
备注：
Results from SurgVisDom 2020 challenge held at MICCAI 2020
Surgical data science is revolutionizing minimally invasive surgery by enabling context-aware applications. However, many challenges exist around surgical data (and health data, more generally) needed to develop context-aware models. This work - presented as part of the Endoscopic Vision (EndoVis) challenge at the Medical Image Computing and Computer Assisted Intervention (MICCAI) 2020 conference - seeks to explore the potential for visual domain adaptation in surgery to overcome data privacy concerns. In particular, we propose to use video from virtual reality (VR) simulations of surgical exercises in robotic-assisted surgery to develop algorithms to recognize tasks in a clinical-like setting. We present the performance of the different approaches to solve visual domain adaptation developed by challenge participants. Our analysis shows that the presented models were unable to learn meaningful motion based features form VR data alone, but did significantly better when small amount of clinical-like data was also made available. Based on these results, we discuss promising methods and further work to address the problem of visual domain adaptation in surgical data science. We also release the challenge dataset publicly at https://www.synapse.org/surgvisdom2020.
Unsupervised Surgical Instrument Segmentation via Anchor Generation and Semantic Diffusion
NELVT, Department of Computer Science, Peking University（北京大学计算机科学技术系数字视频编解码技术国家工程实验室）；Deepwise AI Lab（深睿医疗人工智能实验室）；Center on Frontiers of Computing Studies, Peking University（北京大学前沿计算研究中心）；Advanced Institute of Information Technology, Peking University（北京大学信息技术高等研究院）；Peking University Cancer Hospital（北京大学肿瘤医院）
Objective Surgical Skills Assessment and Tool Localization: Results from the MICCAI 2021 SimSurgSkill Challenge
Intuitive, Inc.（直觉外科公司）；Muroran Institute of Technology（室兰工业大学）；University College London（伦敦大学学院）；Shandong University（山东大学）；German Cancer Research Center (DKFZ)（德国癌症研究中心）；National Center for Tumor Diseases (NCT)（国家肿瘤疾病中心）
Video Dataset for Surgical Phase, Keypoint, and Instrument Recognition in Laparoscopic Surgery (PhaKIR)
Regensburg Medical Image Computing (ReMIC), OTH Regensburg（雷根斯堡医学影像计算中心（ReMIC））；Regensburg Center of Biomedical Engineering (RCBE), OTH Regensburg（雷根斯堡生物医学工程中心（RCBE））；Regensburg University（雷根斯堡大学）；Regensburg Center of Health Sciences（雷根斯堡健康科学中心）；Technical University of Munich (TUM)（慕尼黑技术大学）；TUM University Hospital（慕尼黑技术大学医院）；Biomedical Image Analysis Group, Department of Computing, Imperial College London（生物医学影像分析组，计算部门，伦敦帝国学院）；Research Group MITI, TUM University Hospital, School of Medicine（MITI研究组，慕尼黑技术大学医院，医学学院）；Department of Surgery, TUM University Hospital, School of Medicine（外科部门，慕尼黑技术大学医院，医学学院）
CholecTriplet2021: A benchmark challenge for surgical action triplet recognition
University of Strasbourg（斯特拉斯堡大学）；CNRS（法国国家科学研究中心）；IHU Strasbourg（斯特拉斯堡大学医院研究所）；University of Chicago（芝加哥大学）；Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences（中国科学院深圳先进技术研究院）；Hefei University of Technology（合肥工业大学）；Shanghai Jiao Tong University（上海交通大学）；Argonne National Laboratory（阿贡国家实验室）；Medtronic（美敦力）；Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所）
SurgRIPE challenge: Benchmark of Surgical Robot Instrument Pose Estimation
The Hamlyn Centre for Robotic Surgery, Imperial College London, United Kingdom；ImFusion GmbH, Munich, Germany；Technical University of Munich, Munich, Germany；Eindhoven University of Technology, Eindhoven, Netherlands；Department of Engineering Physics, Tsinghua University, Beijing, China；Department of Transdisciplinary Medicine, Seoul National University Hospital, South Korea；School of Computing, University of Leeds, United Kingdom；STORMLab, University of Leeds, United Kingdom
PitVis-2023 Challenge: Workflow Recognition in videos of Endoscopic Pituitary Surgery
University College London（伦敦大学学院）；National Hospital for Neurology and Neurosurgery（国立神经学与神经外科医院）；Centre for AI and Robotics (CAIR) HKISI, CAS（中国科学院香港创新研究院人工智能与机器人中心）；Shanghai Jiao Tong University（上海交通大学）
U-NetPlus: A Modified Encoder-Decoder U-Net Architecture for Semantic and Instance Segmentation of Surgical Instrument
Rochester Institute of Technology（罗切斯特理工学院）；Center for Imaging Science（影像科学中心）；Biomedical Engineering（生物医学工程）
传统的治疗方法由于有限的视野而限制了外科医生的灵活性控制。随着机器人辅助手术的出现，微创手术的医疗技术发生了范式转变。然而，在手术场景中跟踪手术器械的位置是非常具有挑战性的，并且手术工具的准确检测和识别是至关重要的。手术视频帧中基于深度学习的语义分割有可能促进这一任务。在这项工作中，我们修改了名为U-NetPlus的U-Net架构，通过引入预训练的编码器并重新设计解码器部分，通过使用基于最近邻（NN）插值的上采样操作替换转置卷积操作。为了进一步提高性能，我们还采用了非常快速和灵活的数据增强技术。我们在8 x 225帧机器人手术视频序列上训练了框架，这些视频可通过MICCAI 2017 EndoVis Challenge数据集获得，并在8 x 75帧和2 x 300帧视频上进行了测试。使用我们的U-NetPlus架构，我们报告了90.20%的DICE用于二进制分割，76.26%的DICE用于仪器部件分割，46.07%用于仪器类型（即，所有仪器）分割，优于在这些数据上实施和测试的先前技术的结果。
Effective semantic segmentation in Cataract Surgery: What matters most?
University College London (UCL)（伦敦大学学院）；King’s College London (KCL)（伦敦国王学院）；Moorfields Eye Hospital（摩尔菲尔兹眼科医院）；Institute of Ophthalmology, University College London（伦敦大学学院眼科研究所）；Wellcome/EPSRC Centre for Interventional and Surgical Sciences（惠康/英国工程与物理科学研究委员会介入与外科科学中心）；School of Biomedical Engineering & Imaging Sciences（生物医学工程与影像科学学院）
Surgical-DeSAM: Decoupling SAM for Instrument Segmentation in Robotic Surgery
Wellcome/EPSRC Centre for Interventional and Surgical Sciences (WEISS)（Wellcome/EPSRC介入与外科科学中心（WEISS））；University College London（伦敦大学学院）；Dept. of Computer Science, University College London（伦敦大学学院计算机科学系）
Automated segmentation of pediatric neuroblastoma on multi-modal MRI: Results of the SPPIN challenge at MICCAI 2023
Princess Máxima Center for Pediatric Oncology（玛西玛公主儿科肿瘤中心）；University Medical Center Utrecht（乌得勒支大学医学中心）；Utrecht University（乌得勒支大学）；Osaka University（大阪大学）；Muroran Institute of Technology（室兰工业大学）；Niigata University of Health and Welfare（新潟医疗福祉大学）；AGH University of Krakow（克拉科夫AGH科技大学）；HES-SO Valais-Wallis（瑞士西部应用科学与艺术大学瓦莱分校）；University of Geneva（日内瓦大学）；Shanghai Artificial Intelligence Laboratory（上海人工智能实验室）；South China Normal University（华南师范大学）；La Fe Health Research Institute（拉费健康研究所）；University of Nebraska Medical Center（内布拉斯加大学医学中心）；Wageningen Food Safety Research（瓦赫宁根食品安全研究所）
SurgT challenge: Benchmark of Soft-Tissue Trackers for Robotic Surgery
Imperial College London（伦敦帝国理工学院）；Jmees（Jmees公司）；Electronics and Telecommunications Research Institute (ETRI)（电子通信研究院）；Ajou University（亚洲大学）；University of Toronto（多伦多大学）；University College London（伦敦大学学院）
Surgical-VQA: Visual Question Answering in Surgical Scenes using Transformer
National University of Singapore（新加坡国立大学）；Imperial College London（帝国理工学院）；National Institute of Technology, Tiruchirappalli（蒂鲁吉拉伯利国家理工学院）；Chinese University of Hong Kong（香港中文大学）；Shun Hing Institute of Advanced Engineering（信兴高等工程研究所）
Surgical-DINO: Adapter Learning of Foundation Models for Depth Estimation in Endoscopic Surgery
The Chinese University of Hong Kong（香港中文大学）；Wellcome/EPSRC Centre for Interventional and Surgical Sciences (WEISS), University College London（伦敦大学学院惠康/工程与物理科学研究委员会介入与外科科学中心）；National University of Singapore（新加坡国立大学）
OSS: Open Suturing Skills Vision-Based Assessment Challenge 2024-2025
Department of Translational Surgical Oncology, National Center for Tumor Diseases (NCT/UCC) Dresden（转化外科肿瘤学部，肿瘤疾病国家中心（NCT/UCC）德累斯顿）；The Centre for Tactile Internet with Human-in-the-Loop (CeTI), TUD Dresden University of Technology（具有人环路触觉互联网中心（CeTI），德累斯顿技术大学）；Department of Oral and Maxillofacial Surgery, University Hospital RWTH Aachen（口腔和颌面外科部，亚琛大学医院）；Center for Tooth-, Mouth- and Jaw Medicine, University Göttingen（牙科、口科和颌科医学中心，哥廷根大学）；Institute of Medical Informatics, University Hospital RWTH Aachen（医学信息学研究所，亚琛大学医院）；Faculty of Medicine and University Hospital Carl Gustav Carus, TUD Dresden University of Technology（医学系和卡尔·戈斯塔·卡鲁斯大学医院，德累斯顿技术大学）；German Cancer Research Center (DKFZ)（德国癌症研究中心（DKFZ））；Muroran Institute of Technology（牟然技术学院）；Niigata University of Health and Welfare（北九州市保健福利大学）；Konica Minolta, Inc.（柯尼卡美能达公司）；Jmees, Inc.（Jmees公司）；Department of Computer Science and Engineering, The Hong Kong University of Science and Technology（计算机科学与工程部，香港科学与技术大学）；Center Algoritmi/LASI, University of Minho（算法中心/ALASI，米尼奥大学）；Life and Health Sciences Research Institute (ICVS), School of Medicine, University of Minho（生命与健康科学研究院（ICVS），医学院，米尼奥大学）；ICVS/3B's - PT Government Associate Laboratory（ICVS/3B's - PT政府附属实验室）；Institute for AI in Medicine (IKIM), University Medicine Essen（医学人工智能研究所（IKIM），埃森大学医学部）；The Faculty of Data and Decisions Science, Technion - Israel Institute of Technology（数据与决策科学系，技术学院-以色列理工学院）；UCL Hawkes Institute, University College London（UCL Hawkes研究所，伦敦大学学院）；School of Computing, Queen's University（计算学院，皇后大学）；Department of Transdisciplinary Medicine, Seoul National University Hospital（跨学科医学部，首尔国立大学医院）；Interdisciplinary Program in Medical Informatics, Seoul National University（医学信息学跨学科项目，首尔国立大学）；Department of Clinical Medical Sciences, Seoul National University（临床医学科学部，首尔国立大学）；Institute of Convergence Medicine with Innovative Technology, Seoul National University Hospital（融合医学与创新技术研究所，首尔国立大学医院）；Department of Surgery, Seoul National University College of Medicine and Seoul National University Hospital（外科部，首尔国立大学医学院和首尔国立大学医院）
Point Tracking in Surgery--The 2025 Surgical Tattoos in Infrared Challenge (STIRC2025)
Intuitive Surgical Inc.（直观外科公司）；ImFusion GmbH（ImFusion有限公司）；Technical University of Munich（慕尼黑工业大学）；University of British Columbia（英属哥伦比亚大学）；Johns Hopkins University（约翰·霍普金斯大学）；Daegu Gyeongbuk Institute of Science and Technology（大邱庆北科学技术院）；Hamburg University of Technology（汉堡工业大学）；SustAInLivWork Center of Excellence（可持续生活工作卓越中心）；Graduate School of Informatics, Nagoya University（名古屋大学信息科学研究生院）；Information Technology Center, Nagoya University（名古屋大学信息技术中心）；Department of Information Science, Aichi Institute of Technology（爱知工业大学信息科学系）；Research Center for Medical Bigdata, National Institute of Informatics（国立信息学研究所医学大数据研究中心）；Department of Translational Surgical Oncology, National Center for Tumor Diseases (NCT), NCT/UCC Dresden, a partnership between DKFZ, Faculty of Medicine and University Hospital Carl Gustav Carus, TUD Dresde（德累斯顿国家肿瘤疾病中心（NCT）转化外科肿瘤学系，NCT/UCC德累斯顿，由德国癌症研究中心、医学院和卡尔·古斯塔夫·卡鲁斯大学医院、德累斯顿工业大学合作成立）
Intuitive Surgical SurgToolLoc and SurgVU Challenges Results: 2022-2025
Intuitive Surgical, Inc.（Intuitive Surgical公司）；Muroran Institute of Technology（Muroran理工学院）；Niigata University of Health and Welfare Fujita Health University（Niigata大学健康与福利大学 Fujita健康大学）；NVIDIA, Inc.（NVIDIA公司）；University of Tokyo（东京大学）；Keio University（Keio大学）；Shun Hing Institute of Advanced Engineering（Shun Hing先进工程研究所）；NUS NUSRI SZ（新加坡大学 NUSRI SZ）；University of Strasbourg IHU Strasbourg（斯特拉斯堡大学 IHU斯特拉斯堡）；University Medical Center Hambrug-Eppendorf（汉堡-埃彭多夫大学医学中心）
SegCol Challenge: Semantic Segmentation for Tools and Fold Edges in Colonoscopy data
UCL Hawkes Institute, University College London（伦敦大学学院霍克斯学院）；Department of Computer Science, University College London（伦敦大学学院计算机科学系）；Medtronic（美敦力）；Department of Computer Science, University Liverpool（利物浦大学计算机科学系）
Point Tracking in Surgery--The 2024 Surgical Tattoos in Infrared (STIR) Challenge
Intuitive Surgical Inc.（直觉外科公司）；ImFusion GmbH（ImFusion 有限公司）；Technical University of Munich（慕尼黑工业大学）；NVIDIA（英伟达公司）；Daegu Gyeongbuk Institute of Science and Technology (DGIST)（大邱庆北科学技术院）；Czech Technical University in Prague（布拉格捷克技术大学）；Shenzhen Research Institute（深圳研究院）；The Chinese University of Hong Kong（香港中文大学）；Shenzhen University（深圳大学）；Life and Health Sciences Research Institute (ICVS)（生命与健康科学研究所）；University of Minho（米尼奥大学）；IPCA（波尔图高等理工学院）；University of California - Los Angeles (UCLA)（加利福尼亚大学洛杉矶分校）；Hefei University of Technology（合肥工业大学）；Hawkes Institute（霍克斯研究所）
Surgical-VQLA: Transformer with Gated Vision-Language Embedding for Visual Question Localized-Answering in Robotic Surgery
National University of Singapore（新加坡国立大学）；The Chinese University of Hong Kong (CUHK)（香港中文大学）；University College London（伦敦大学学院）；Shun Hing Institute of Advanced Engineering（信兴高等工程研究所）
Comparative validation of surgical phase recognition, instrument keypoint estimation, and instrument instance segmentation in endoscopy: Results of the PhaKIR 2024 challenge
Regensburg Medical Image Computing (ReMIC), OTH Regensburg（雷根萨大学医学影像计算中心）；Research Group MITI, TUM University Hospital, School of Medicine and Health（技术大学慕尼黑大学医院MITI研究组）；Regensburg Center of Biomedical Engineering (RCBE), OTH Regensburg（雷根萨生物医学工程研究中心）；Regensburg University（雷根萨大学）；Regensburg Center of Health Sciences and Technology (RCHST), OTH Regensburg（雷根萨健康科学与技术研究中心）；AI Centre of Excellence, Medtronic Ltd.（医学影像人工智能卓越中心）；Engineering Sciences, University College London（伦敦大学学院工程科学系）；Augmented Intelligence Lab, Kyung Hee University（庆熙大学增强智能实验室）；University of Minho, Braga（明霍大学）；Jmees Inc.（Jmees公司）；School of Sciences, São Paulo State University (UNESP), Bauru（圣保罗州立大学科学学院）；KIST HARILAB, Center for Humanoid Research, Artificial Intelligence and Robot Institute, Korea Institute of Science and Technology (KIST)（韩国科学技术院HARILAB中心）；King's College London（伦敦国王学院）；The Chinese University of Hong Kong（香港中文大学）；Division of Intelligent Medical Systems, German Cancer Research Center (DKFZ)（德国癌症研究中心智能医疗系统部门）；Muroran Institute of Technology, Hokkaido（北海道Muroran技术学院）；Niigata University of Health and Welfare（Niigata医疗福利大学）；Konica Minolta, Inc.（东宝株式会社）；Department of Computer Science and Engineering, The Hong Kong University of Science and Technology（香港科技大学计算机科学与工程系）；Department of Chemical and Biological Engineering, The Hong Kong University of Science and Technology（香港科技大学化学与生物工程系）；HKUST Shenzhen-Hong Kong Collaborative Innovation Research Institute, Shenzhen（香港科技大学深圳-香港协同创新研究院）；Center for Research and Formation in Artificial Intelligence (CinfonIA), Los Andes University, Bogota（安第斯大学人工智能研究与培养中心）；Department of Biomedical Engineering, Medical Image Analysis Group, Eindhoven University of Technology（埃因霍温理工大学生物医学工程系）；Institute of Information Technology (ITEC), Klagenfurt University（克雷格夫大学信息技术研究所）；Center for Tactile Internet with Human-in-the-loop (CeTI), TU Dresden（德累斯顿技术大学触觉互联网中心）
CAT-ViL: Co-Attention Gated Vision-Language Embedding for Visual Question Localized-Answering in Robotic Surgery
Wellcome/EPSRC Centre for Interventional and Surgical Sciences (WEISS), University College London（伦敦大学学院惠康/工程与物理科学研究委员会介入与外科科学中心（WEISS））；The Chinese University of Hong Kong (CUHK)（香港中文大学（CUHK））；Shun Hing Institute of Advanced Engineering, CUHK（香港中文大学信兴高等工程研究所）
Benchmark of Segmentation Techniques for Pelvic Fracture in CT and X-ray: Summary of the PENGWIN 2024 Challenge
Beijing Rossum Robot Technology Co., Ltd.（北京罗素机器人科技有限公司）；Key Laboratory of Biomechanics and Mechanobiology, Ministry of Education, Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University（生物力学与机械生物学重点实验室，教育部，北京生物医学创新中心，生物科学与医学工程学院，北航）；Department of Computer Science, Johns Hopkins University（计算机科学系，约翰霍普金斯大学）；Division of Medical Image Computing, German Cancer Research Center (DKFZ)（医学影像计算部，德国癌症研究中心（DKFZ））；Helmholtz Imaging, Heidelberg（海德堡大学医院影像中心）；Smart Medical Imaging, Learning and Engineering (SMILE) Lab, Medical UltraSound Image Computing（智能医学影像、学习与工程（SMILE）实验室，医学超声影像计算）
Stereo Correspondence and Reconstruction of Endoscopic Data Challenge
Intuitive Inc.（直觉外科公司）；Fraunhofer Institute for Telecommunications, Heinrich Hertz Institute (HHI)（弗劳恩霍夫海因里希·赫兹通信研究所）；University of Western Ontario（西安大略大学）；Digital Surgery Ltd.（数字外科有限公司）；Norwegian University of Science and Technology（挪威科技大学）；Rediminds Inc.（Rediminds公司）；Harbin Institute of Technology（哈尔滨工业大学）；Shenzhen Institutes of Advanced Technology（深圳先进技术研究院）；Johns Hopkins University（约翰斯·霍普金斯大学）；Heidelberg University（海德堡大学）；German Cancer Research Center (DKFZ)（德国癌症研究中心）；National Center for Tumor Diseases (NCT)（国家肿瘤疾病中心）；Wellcome/EPSRC Centre for Interventional and Surgical Sciences (WEISS) UCL（伦敦大学学院惠康/EPSRC介入与外科科学中心）；University of Bern（伯尔尼大学）
More than Segmentation: Benchmarking SAM 3 for Segmentation, 3D Perception, and Reconstruction in Robotic Surgery
The Chinese University of Hong Kong（香港中文大学）；The Hong Kong University of Science and Technology（香港科学与技术大学）；The Hong Kong University of Science and Technology (Guangzhou)（香港科学与技术大学（广州））；Technical University of Munich（慕尼黑技术大学）
Digital Surgery Ltd, Medtronic（美敦力数字外科有限公司）；ICube, University of Strasbourg, CNRS, IHU Strasbourg（斯特拉斯堡大学ICube实验室、法国国家科学研究中心、斯特拉斯堡大学医院）；Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所）；Hutom（Hutom公司）；Xiamen University（厦门大学）；University of Electronic Science and Technology of China（电子科技大学）；National University of Singapore（新加坡国立大学）；National Institute of Technology, Raipur（赖布尔国家理工学院）；King’s College London（伦敦国王学院）；University College London（伦敦大学学院）
SAM Meets Robotic Surgery: An Empirical Study on Generalization, Robustness and Adaptation
University College London（伦敦大学学院）；National University of Singapore（新加坡国立大学）；Hubei University of Technology（湖北工业大学）；The Chinese University of Hong Kong（香港中文大学）
本文在 EndoVis 2017/2018 上实证评估 SAM 的手术器械零样本分割、扰动鲁棒性与提示表现，并通过 LoRA 微调提出无需提示的 SurgicalSAM。
ST-MTL: Spatio-Temporal Multitask Learning Model to Predict Scanpath While Tracking Instruments in Robotic Surgery
NUS Graduate School for Integrative Sciences and Engineering (NGS), National University of Singapore（新加坡国立大学综合科学与工程研究生院）；Dept. of Biomedical Engineering, National University of Singapore（新加坡国立大学生物医学工程系）；Dept. of Instrumentation and Control Engineering, NIT Trichy（印度国立理工学院蒂鲁奇拉帕利分校仪器与控制工程系）；Dept. of Otolaryngology, Singapore General Hospital（新加坡中央医院耳鼻喉科）
