Autonomy is the frontier of research in robotic surgery and its aim is to improve the quality of surgical procedures in the next future. One fundamental requirement for autonomy is advanced perception capability through vision sensors. In this paper, we propose a novel calibration technique for a surgical scenario with da Vinci robot. Calibration of the camera and the robot is necessary for precise positioning of the tools in order to emulate the high performance surgeons. Our calibration technique is tailored for RGB-D camera. Different tests performed on relevant use cases for surgery prove that we significantly improve precision and accuracy with respect to the state of the art solutions for similar devices on a surgical-size setup. Moreover, our calibration method can be easily extended to standard surgical endoscope to prompt its use in real surgical scenario.
Synthetic and Real Inputs for Tool Segmentation in Robotic Surgery
Wellcome/EPSRC Centre for Interventional and Surgical Sciences (WEISS), University College London(伦敦大学学院威康/EPSRC介入与外科科学中心);Department of Computer Science, University College London(伦敦大学学院计算机科学系)
Scene Graph-Driven Haptic Feedback for Safety Enhancement in Robotic Ophthalmic Surgery via Physically Simulated iOCT
Munich Institute of Robotics and Machine Intelligence (MIRMI), Technical University of Munich (TUM)(慕尼黑工业大学慕尼黑机器人与机器智能研究所);TUM School of Engineering and Design, Technical University of Munich (TUM)(慕尼黑工业大学工程与设计学院)
Relational Graph Learning on Visual and Kinematics Embeddings for Accurate Gesture Recognition in Robotic Surgery
The Chinese University of Hong Kong(香港中文大学);Johns Hopkins University(约翰斯·霍普金斯大学)
自动手术手势识别对于机器人手术中的智能认知辅助至关重要。随着近年来机器人辅助微创手术的发展,可以记录包括手术视频和机器人运动学在内的丰富信息,这些信息为理解手术手势提供了补充知识。然而,现有的方法要么单独采用单模态数据或直接连接多模态表示,这不能充分利用视觉和运动学数据中固有的信息相关性来提高手势识别的准确性。在这方面,我们提出了一种新的多模态关系图网络的在线方法(即,MRG-Net)通过在潜在特征空间中的交互式消息传播来动态地整合视觉和运动学信息。具体来说,我们首先使用时间卷积网络和LSTM单元从视频和运动序列中提取嵌入。接下来,我们识别这些多模态嵌入中的多关系,并通过层次关系图学习模块来利用它们。我们的方法的有效性证明了国家的最先进的结果在公共JIGSAWS数据集,优于目前的单模态和多模态的方法在两个节点和结类型的任务。此外,我们在两个中心的da Vinci Research Kit(dVRK)平台收集的内部视觉运动学数据集上验证了我们的方法,并实现了一致的有希望的性能。
ST-MTL: Spatio-Temporal Multitask Learning Model to Predict Scanpath While Tracking Instruments in Robotic Surgery
NUS Graduate School for Integrative Sciences and Engineering (NGS), National University of Singapore(新加坡国立大学综合科学与工程研究生院);Dept. of Biomedical Engineering, National University of Singapore(新加坡国立大学生物医学工程系);Dept. of Instrumentation and Control Engineering, NIT Trichy(印度国立理工学院蒂鲁奇拉帕利分校仪器与控制工程系);Dept. of Otolaryngology, Singapore General Hospital(新加坡中央医院耳鼻喉科)
TraSeTR: Track-to-Segment Transformer with Contrastive Query for Instance-level Instrument Segmentation in Robotic Surgery
The Chinese University of Hong Kong(香港中文大学);Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);University College London(伦敦大学学院)
Can DeepSeek Reason Like a Surgeon? An Empirical Evaluation for Vision-Language Understanding in Robotic-Assisted Surgery
The Chinese University of Hong Kong(香港中文大学);University of Strasbourg(斯特拉斯堡大学);CNRS(法国国家科学研究中心);INSERM(法国国家健康与医学研究院);ICube(ICube实验室);IHU Strasbourg(斯特拉斯堡大学医院研究所)
Dynamic Interactive Relation Capturing via Scene Graph Learning for Robotic Surgical Report Generation
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));University College London(伦敦大学学院);The Hong Kong University of Science and Technology(香港科技大学)
Surgical-MambaLLM: Mamba2-enhanced Multimodal Large Language Model for VQLA in Robotic Surgery
Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州));Imperial College London(帝国理工学院伦敦分校);The Hong Kong University of Science and Technology(香港科学与技术大学)
Self-Supervised Siamese Learning on Stereo Image Pairs for Depth Estimation in Robotic Surgery
The Hamlyn Centre for Robotic Surgery, IGHI, Imperial College London(伦敦帝国理工学院哈姆林机器人手术中心);Dyson Robotics Laboratory, Imperial College London(伦敦帝国理工学院戴森机器人实验室);OpenAI;Department of Surgery and Cancer, Imperial College London(伦敦帝国理工学院外科与癌症系)
Primary Experimental Feedback on a Co-manipulated Robotic System for Assisted Cervical Surgery
Pprime Institute(Pprime研究所);University of Poitiers(普瓦捷大学);CNRS(法国国家科学研究中心);ISAE-ENSMA(法国高等航空航天学院-国立高等机械与航空技术学院);Centre Hospitalier Universitaire (CHU)(大学教学医院(CHU));National Central University(国立中央大学);National Engineering School of Sousse(苏塞国立工程师学院);University of Sousse(苏塞大学)
Image-to-Force Estimation for Soft Tissue Interaction in Robotic-Assisted Surgery Using Structured Light
School of Electronic Information Engineering, Tongji University(同济大学电子与信息工程学院);MicroPort MedBot (Group) Company Ltd.(微创医疗机器人(集团)股份有限公司);College of Engineering, Peking University(北京大学工学院);City University of Hong Kong(香港城市大学)
Real-Time Instrument Segmentation in Robotic Surgery using Auxiliary Supervised Deep Adversarial Learning
NUS Graduate School for Integrative Sciences and Engineering (NGS)(新加坡国立大学综合科学与工程研究生院(NGS));National University of Singapore(新加坡国立大学);University of Moratuwa(莫拉图瓦大学);NIT Trichy(印度国立理工学院蒂鲁吉拉伯利分校)
Learning Domain Adaptation with Model Calibration for Surgical Report Generation in Robotic Surgery
National University of Singapore(新加坡国立大学);NUSRI Suzhou China(新加坡国立大学苏州研究院);The Chinese University of Hong Kong(香港中文大学);Imperial College London(伦敦帝国理工学院);Duke-NUS Medical School(杜克-新加坡国立大学医学院)
Deliberation in autonomous robotic surgery: a framework for handling anatomical uncertainty
University of Verona(维罗纳大学)
自主机器人手术需要深思熟虑,即计划和执行适应不确定和动态环境的任务的能力。手术领域的不确定性主要与患者特定解剖特性的部分术前知识有关。在本文中,我们介绍了一个逻辑为基础的框架与审议功能的监测和学习的手术任务。DEliberative Framework for Robot-Assisted Surgery(DEFRAS)估计术前患者特定计划,并在连续测量从生物力学术前模型获得的作用力的同时执行该计划。监控模块将该模型与传感器重构的实际情况进行比较。在显著不匹配的情况下,调用学习模块来更新模型,从而改进对所施加的力的估计。DEFRAS在模拟和真实环境中使用da Vinci Research Kit执行软组织牵开进行了确认。与最先进的相关工作相比,提高了任务的成功率,同时最大限度地减少了与组织的相互作用,以防止意外的损伤。
Towards Robotic Eye Surgery: Marker-free, Online Hand-eye Calibration using Optical Coherence Tomography Images
Technische Universität München(慕尼黑工业大学);Carl Zeiss Meditec(卡尔蔡司医疗技术公司);Sun Yat-Sen University(中山大学);Klinikum rechts der Isar der Technische Universität München(慕尼黑工业大学 Rechts der Isar 医院)
An innovative mixed reality approach for Robotics Surgery
Technical University of Cluj-Napoca(克卢日-纳波卡技术大学);Nantes Université(南特大学);École Centrale Nantes(南特中央理工学院);CNRS(法国国家科学研究中心);LS2N(南特数字科学实验室);Technical Sciences Academy of Romania(罗马尼亚技术科学院)