This article reviews the recent advances in intelligent robotic ultrasound (US) imaging systems. We commence by presenting the commonly employed robotic mechanisms and control techniques in robotic US imaging, along with their clinical applications. Subsequently, we focus on the deployment of machine learning techniques in the development of robotic sonographers, emphasizing crucial developments aimed at enhancing the intelligence of these systems. The methods for achieving autonomous action reasoning are categorized into two sets of approaches: those relying on implicit environmental data interpretation and those using explicit interpretation. Throughout this exploration, we also discuss practical challenges, including those related to the scarcity of medical data, the need for a deeper understanding of the physical aspects involved, and effective data representation approaches. Moreover, we conclude by highlighting the open problems in the field and analyzing different possible perspectives on how the community could move forward in this research area.
USPilot: An Embodied Robotic Assistant Ultrasound System with Large Language Model Enhanced Graph Planner
Department of Biomedical Engineering, City University of Hong Kong(城市大学生物医学工程系);Department of Mechanical and Automation Engineering, Chinese University of Hong Kong(香港中文大学机械与自动化工程系);Centre for Artificial Intelligence and Robotics Hong Kong Institute of Science & Innovation, Chinese Academy of Sciences(中国科学院香港科学与创新研究院人工智能与机器人中心);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Department of Surgical and Interventional Engineering, King’s College London(伦敦国王学院外科与介入工程系)
Implicit Neural Representations for Breathing-compensated Volume Reconstruction in Robotic Ultrasound
Technical University of Munich(慕尼黑工业大学);Sharif University of Technology(谢里夫理工大学);Stanford University School of Medicine(斯坦福大学医学院);ImFusion GmbH(ImFusion有限公司);Munich Center for Machine Learning(慕尼黑机器学习中心)
Action-Conditioned World Model for Goal Plane Guidance in Robotic Neck Ultrasound
Department of Mechanical and Automation Engineering, Chinese University of Hong Kong(香港中文大学机械与自动化工程学系);Department of Biomedical Engineering, City University of Hong Kong(香港城市大学生物医学工程学系);Centre for Artificial Intelligence and Robotics Hong Kong Institute of Science & Innovation, Chinese Academy of Sciences(中国科学院香港创新研究院人工智能与机器人中心);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Department of Surgical and Interventional Engineering, King’s College London(伦敦国王大学外科与介入工程学系);Department of Vascular Ultrasound, Xuanwu Hospital, the Capital Medical University(首都医科大学宣武医院血管超声科)
Robotic-assisted Ultrasound for Fetal Imaging: Evolution from Single-arm to Dual-arm System
King’s College London(伦敦国王学院);Xtronics Ltd.(Xtronics有限公司);Guy’s & St Thomas’ NHS Foundation Trust(盖伊和圣托马斯NHS基金会信托);Evelina Children’s Hospital(伊芙琳娜儿童医院);Queen Mary University of London(伦敦玛丽女王大学)
DAISS: Phase-Aware Imitation Learning for Dual-Arm Robotic Ultrasound-Guided Interventions
Chair for Computer Aided Medical Procedures(CAMP), Technical University of Munich(TUM)(计算机辅助医疗程序主席职位(CAMP),慕尼黑技术大学);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心);The University of Hong Kong(HKU)(香港大学)
UltraTac: Integrated Ultrasound-Augmented Visuotactile Sensor for Enhanced Robotic Perception
Shenzhen Ubiquitous Data Enabling Key Lab, Shenzhen International Graduate School, Tsinghua University(深圳 ubiquitous 数据赋能重点实验室,深圳国际研究生院,清华大学);RISC-V International Open Source Laboratory(RISC-V国际开源实验室)
Recon2Servo: Robotic Ultrasound Visual Servoing via Learned Image-to-Motion Inference
The University of Hong Kong(香港大学);The Chinese University of Hong Kong(香港中文大学);Technical University of Munich(慕尼黑工业大学);Hong Kong Polytechnic University(香港理工大学)
SonoGym: High Performance Simulation for Challenging Surgical Tasks with Robotic Ultrasound
Balgrist University Hospital(巴尔格里斯大学医院);ETH Zurich(苏黎世联邦理工学院);University of Toronto(多伦多大学);NVIDIA(NVIDIA公司);ETH AI Center(苏黎世联邦理工学院人工智能中心);University of Zurich(苏黎世大学)
Contact-Adaptive Robotic Ultrasound Probe Control for Tissue Exploration and Continuous Task-Relevant Visualization Using Robot-Free Image-Motion Demonstration
Seoul National University Hospital(首尔大学医院);Rosota Inc.(Rosota公司);Seoul National University College of Medicine(首尔大学医学院);Seoul National University(首尔大学);Eulji University College of Medicine(乙支大学医学院)
AIA-UltraNeRF:Acoustic-Impedance-Aware Neural Radiance Field with Hash Encodings for Robotic Ultrasound Reconstruction and Localization
School of Management, Hefei University of Technology(合肥工业大学管理学院);First Affiliated Hospital of University of Science and Technology of China(中国科学技术大学第一附属医院);Department of Ultrasound Diagnosis, the Second Xiangya Hospital of Central South University(中南大学湘雅医学院第二医院超声诊断科);Intelligent Ultrasound Division of VINNO Technology Co., Ltd.(VINNO技术有限公司智能超声事业部);Department of Automation, Tsinghua University(清华大学自动化系)
Robotic Ultrasound Imaging: State-of-the-Art and Future Perspectives
Technische Universität München(慕尼黑工业大学);Technical University of Munich(慕尼黑工业大学);University of British Columbia(不列颠哥伦比亚大学);Johns Hopkins University(约翰斯·霍普金斯大学)
Ultrasound-Guided Robotic Blood Drawing and In Vivo Studies on Submillimetre Vessels of Rats
Tongji University(同济大学);Chengdu Aixam Medical Technology Co., Ltd.(成都 Aixam 医疗科技有限公司);Katholieke Universiteit Leuven(鲁汶大学);Scuola Superiore Sant’Anna(圣安娜高等学校);Shanghai East Hospital, School of Medicine, Tongji University(同济大学医学院附属上海东方医院);State Key Laboratory of Cardiovascular Diseases(心血管疾病国家重点实验室)
Visuotactile and Explicitly Force-Controlled Robotic Ultrasound for Abdominal Volumetric Reconstruction
Stanford Robotics Laboratory, Computer Science Department, Stanford University(斯坦福机器人实验室、计算机科学系、斯坦福大学);Department of Radiology, School of Medicine, Stanford University(放射科、医学院、斯坦福大学)
Task-Relevant Feature-Dynamics Fidelity Enables Zero-Shot Sim-to-Real Transfer for Robotic Ultrasound Scanning
The Chinese University of Hong Kong(香港中文大学);Great Bay University(大湾区大学);Dongguan Great Bay Institute for Advanced Study(东莞大湾区先进研究院);The University of Hong Kong(香港大学);Southern University of Science and Technology(南方科技大学)
RAG-RUSS: A Retrieval-Augmented Robotic Ultrasound for Autonomous Carotid Examination
Computer-Aided Medical Procedures and Augmented Reality (CAMP), Technical University of Munich (TUM), Germany(计算机辅助医学程序与增强现实(CAMP),慕尼黑技术大学(TUM),德国);Munich Center for Machine Learning (MCML), Germany(慕尼黑机器学习中心(MCML),德国)
Vibration-Based Energy Metric for Restoring Needle Alignment in Autonomous Robotic Ultrasound
Multi-scale Medical Research Center(多尺度医学研究中心);Department of Translational Surgical Oncology(转化外科肿瘤学系);Technical University of Munich(慕尼黑技术大学);The Chinese University of Hong Kong(香港中文大学);Centre for Tactile Internet with Human-in-the-Loop(人机协同触觉互联网中心);Munich Center for Machine Learning(慕尼黑机器学习中心);TUD Dresden University of Technology(德累斯顿技术大学);Federal Ministry of Research, Technology and Space of Germany(德国联邦研究、技术和空间部);Bavarian Ministry of Science and the Arts(巴伐利亚科学与艺术部);Saxon Ministry for Science, Culture, and Tourism(萨克森科学、文化和旅游部)
Chair for Computer-Aided Medical Procedures and Augmented Reality, Technical University of Munich(计算机辅助医学程序与增强现实 chair,慕尼黑技术大学);Munich Center for Machine Learning(慕尼黑机器学习中心);The University of Hong Kong(香港大学)
Transforming Surgical Interventions with Embodied Intelligence for Ultrasound Robotics
Centre for Artificial Intelligence and Robotics (CAIR), HKISI-CAS(香港中文大学(深圳)人工智能与机器人中心(HKISI-CAS));Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)
Feasibility of Augmented Reality-Guided Robotic Ultrasound with Cone-Beam CT Integration for Spine Procedures
Chair for Computer Aided Medical Procedures(CAMP), Technical University of Munich(TUM)(计算机辅助医疗程序系(CAMP),慕尼黑技术大学);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心)
Needle Segmentation Using GAN: Restoring Thin Instrument Visibility in Robotic Ultrasound
Technical University of Munich(慕尼黑工业大学);Klinikum rechts der Isar(右侧伊萨尔医院);DZHK (German Centre for Cardiovascular Research)(德国心血管研究中心);Shanghai Tongji Hospital(上海同济医院);Tongji University School of Medicine(同济大学医学院);The Chinese University of Hong Kong(香港中文大学);Multi-scale Medical Robotics Centre(多尺度医学机器人中心)