HyperVLP: Enhancing Hierarchical Surgical Video-Language Pre-training in Hyperbolic Space
Zhejiang University(浙江大学);University of Strasbourg, CNRS, INSERM, ICube, UMR7357(斯特拉斯堡大学,CNRS,INSERM,ICube,UMR7357);IHU Strasbourg(斯特拉斯堡IHU);Technical University of Munich(慕尼黑工业大学)
Yaojun Hu, Kun Yuan, Nassir Navab, Haochao Ying, Jian Wu, Nicolas Padoy
Surgical vision-language foundation models typically adopt educational materials, such as surgical lecture videos, to transfer surgical knowledge encoded in language into visual representations. These knowledge are multi-dimensional and hierarchical: fine-grained action cues appear in narration, mid-level key steps are summarized in subsection headings, and global procedural context, such as patient history and surgical strategy, is described in abstract texts. Prior work largely collapses these heterogeneous signals into a single flat embedding space, implicitly assuming independence across hierarchy levels. However, this is suboptimal because it ignores cross-level semantic containment, e.g., actions belong to steps, steps compose phases, weakens long-range dependency modeling. To this end, we propose a hyperbolic surgical video-language pre-training framework that explicitly preserves the hierarchical structure by mitigating structural false negatives induced by procedural context and enforcing semantic consistency between parent phases and their constituent child steps. Extensive experiments on multiple surgical benchmarks show consistent gains in zero- and few-shot phase recognition across procedures and institutions.
Digital Surgery(数字外科公司);Kasetsart University(农业大学)
Surgical simulation is an increasingly important element of surgical education. Using simulation can be a means to address some of the significant challenges in developing surgical skills with limited time and resources. The photo-realistic fidelity of simulations is a key feature that can improve the experience and transfer ratio of trainees. In this paper, we demonstrate how we can enhance the visual fidelity of existing surgical simulation by performing style transfer of multi-class labels from real surgical video onto synthetic content. We demonstrate our approach on simulations of catarac…
fine-CLIP: Enhancing Zero-Shot Fine-Grained Surgical Action Recognition with Vision-Language Models
University of Strasbourg(斯特拉斯堡大学);CNRS(法国国家科学研究中心);INSERM(法国国家健康与医学研究院);ICube(ICube实验室);IHU Strasbourg(斯特拉斯堡大学医院研究所);University Hospital of Strasbourg(斯特拉斯堡大学医院)
SurgicaL-CD: Generating Surgical Images via Unpaired Image Translation with Latent Consistency Diffusion Models
NCT/UCC Dresden(德累斯顿癌症中心/癌症联盟);DKFZ Heidelberg(海德堡德国癌症研究中心);Faculty of Medicine and University Hospital Carl Gustav Carus, TUD Dresden University of Technology(德累斯顿工业大学卡尔·古斯塔夫·卡鲁斯医学院及大学医院);HZDR Dresden(德累斯顿亥姆霍兹中心);The Centre for Tactile Internet with Human-in-the-Loop (CeTI), TUD Dresden University of Technology(德累斯顿工业大学人机交互触觉互联网中心)
Surgical-MambaLLM: Mamba2-enhanced Multimodal Large Language Model for VQLA in Robotic Surgery
Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州));Imperial College London(帝国理工学院伦敦分校);The Hong Kong University of Science and Technology(香港科学与技术大学)
Surgformer: Surgical Transformer with Hierarchical Temporal Attention for Surgical Phase Recognition
The Hong Kong University of Science and Technology(香港科技大学);Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);HKUST Shenzhen-Hong Kong Collaborative Innovation Research Institute(香港科技大学深港协同创新研究院)
University of Strasbourg(斯特拉斯堡大学);CNRS(法国国家科学研究中心);INSERM(法国国家健康与医学研究院);ICube(ICube研究中心);UMR7357(法国大学-研究中心7357);IHU Strasbourg(斯特拉斯堡IHU医院);University Digestive Health Care Center – Clarunis(大学消化健康中心 – Clarunis);Ludwig Maximilian University of Munich(慕尼黑路易斯·马克西米利安大学);Chinese University of Hong Kong(香港中文大学);Munich Center for Machine Learning(慕尼黑机器学习中心)
SEDMamba: Enhancing Selective State Space Modelling with Bottleneck Mechanism and Fine-to-Coarse Temporal Fusion for Efficient Error Detection in Robot-Assisted Surgery
UCL Hawkes Institute(伦敦大学学院霍克斯研究所);University College London(伦敦大学学院);Griffin Institute(格里芬研究所);Northwick Park and St Mark’s Hospital(诺斯威克公园与圣马克医院)
A Weak-Signal-Aware Framework for Subsurface Defect Detection: Mechanisms for Enhancing Low-SCR Hyperbolic Signatures
Road and Traffic Engineering Research Center, Zhejiang Normal University(浙江师范大学道路与交通工程研究中心);School of Information and Communication Technology, Griffith University(格里菲斯大学信息与通信技术学院);School of Cyber Science and Engineering, Southeast University(东南大学网络空间安全学院);School of Artificial Intelligence, Hainan Normal University(海南师范大学人工智能学院)
Slot-BERT: Self-supervised Object Discovery in Surgical Video
Outcomes Laboratory, Department of Surgery, University of Pennsylvania, Philadelphia, PA, USA.;Department of Computer;Information Science, University of Pennsylvania, Philadelphia, PA, USA.;Division of Thoracic Surgery, Toronto General Hospital, University Health Network, Toronto, Ontario, Canada.;Surgical Artificial Intelligence Research Academy, University Health Network, Toronto, ON, Canada.
SurgBox: Agent-Driven Operating Room Sandbox with Surgery Copilot
CAIR, HKISI, CAS(中国科学院香港中文大学信息安全研究所智能计算研究中心);MAIS, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所多模态人工智能系统实验室);Peking Union Medical College Hospital(北京协和医院)
From Pre- to Intra-operative MRI: Predicting Brain Shift in Temporal Lobe Resection for Epilepsy Surgery
Surgical and Interventional Engineering(外科与介入工程);King’s College London(伦敦国王学院);National Hospital for Neurology and Neurosurgery(神经外科医院);NHS(国家健康服务);Neurosurgery, King’s College Hospital(神经外科,伦敦国王学院医院);Fondazione IRCCS Ca’ Granda(IRCCS Ca’ Granda基金会);Ospedale Maggiore di Milano(米兰大医院)
LACOSTE: Exploiting stereo and temporal contexts for surgical instrument segmentation
School of Biomedical Engineering, Division of Life Sciences and Medicine, University of Science and Technology of China (USTC)(中国科学技术大学生命科学与医学部生物医学工程学院);Suzhou Institute for Advanced Research, USTC(中国科学技术大学苏州研究院);Key Laboratory of Precision and Intelligent Chemistry, USTC(中国科学技术大学精准与智能化学重点实验室)
Think Step by Step: Chain-of-Gesture Prompting for Error Detection in Robotic Surgical Videos
Tsinghua University(清华大学);National University of Singapore(新加坡国立大学);University College London(伦敦大学学院);Wellcome/EPSRC Centre for Interventional and Surgical Sciences(Wellcome/EPSRC介入与外科科学中心)
F2PASeg: Feature Fusion for Pituitary Anatomy Segmentation in Endoscopic Surgery
1Centre for Artificial Intelligence;Robotics, Hong Kong Institute of Science \& Innovation, Chinese Academy of Sciences 2The University of Hong Kong 3Peking Union Medical College Hospital, Chinese Academy of Medical Science
EyePCR: A Comprehensive Benchmark for Fine-Grained Perception, Knowledge Comprehension and Clinical Reasoning in Ophthalmic Surgery
School of Computer Science & Software Engineering, Shenzhen University(深圳大学计算机科学与软件工程学院);School of Computer Science, University of Nottingham Ningbo China(诺丁汉大学宁波校区计算机科学学院);Wenzhou Medical University(温州医科大学);School of Computer Science, University of Nottingham(诺丁汉大学计算机科学学院)
HLFormer: Enhancing Partially Relevant Video Retrieval with Hyperbolic Learning
Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳));Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);Research Center of Artificial Intelligence, Peng Cheng Laboratory(鹏城实验室人工智能研究中心);The Hong Kong University of Science and Technology(香港科学与技术大学)
SurgiSR4K: A High-Resolution Endoscopic Video Dataset for Robotic-Assisted Minimally Invasive Procedures
Intuitive Surgical, Inc.(Intuitive Surgical公司);Johns Hopkins Medicine Neurosurgery(约翰霍普金斯医学神经外科);Johns Hopkins University Electrical and Computer Engineering(约翰霍普金斯大学电气与计算机工程);University of British Columbia Electrical and Computer Engineering(不列颠哥伦比亚大学电气与计算机工程);Wilford & Kate Bailey Small Animal Teaching Hospital(威尔福德与凯蒂·贝利小动物教学医院)
Beyond Euclidean: Dual-Space Representation Learning for Weakly Supervised Video Violence Detection
Chongqing University of Posts and Telecommunications(重庆邮电大学);Chongqing Institute for Brain and Intelligence(重庆脑与智能研究院);Guangyang Bay Laboratory(广阳湾实验室)