Video is an essential imaging modality for diagnostics, e.g. in ultrasound imaging, for endoscopy, or movement assessment. However, video hasn't received a lot of attention in the medical image analysis community. In the clinical practice, it is challenging to utilise raw diagnostic video data efficiently as video data takes a long time to process, annotate or audit. In this paper we introduce a novel, fully automatic video summarization method that is tailored to the needs of medical video data. Our approach is framed as reinforcement learning problem and produces agents focusing on the preservation of important diagnostic information. We evaluate our method on videos from fetal ultrasound screening, where commonly only a small amount of the recorded data is used diagnostically. We show that our method is superior to alternative video summarization methods and that it preserves essential information required by clinical diagnostic standards.
Unsupervised multi-latent space reinforcement learning framework for video summarization in ultrasound imaging
Indian Institute of Technology(印度理工学院);University of Alberta(阿尔伯塔大学);Hospital Universitario Puerta de Hierro(普埃塔德耶罗大学医院);Government Medical College(政府医学院);Sree Chitra Tirunal Institute of Medical Sciences and Technology(斯里奇特拉图鲁纳尔医学科学与技术研究所);Bhagwan Mahaveer Jain Hospital(巴格万马哈维尔耆那医院)
Comprehensive Review of Reinforcement Learning for Medical Ultrasound Imaging
Concordia University(康考迪亚大学);Ecole de Technologie Superieure (ETS)(高等技术学院);Laval University(拉瓦尔大学);Khalifa University(哈利法大学);Lebanese American University(黎巴嫩美国大学)
covEcho Resource constrained lung ultrasound image analysis tool for faster triaging and active learning
Indian Institute of Technology Palakkad(印度理工学院帕拉卡德分校);Hospital Universitario Puerta de Hierro(普埃尔塔·德·耶罗大学医院);Sree Chitra Tirunal Institute for Medical Sciences & Technology(斯里·奇特拉·蒂鲁纳尔医学科学与技术研究所);Government Medical College Thiruvananthapuram(特里凡得琅政府医学院)
Goal-conditioned reinforcement learning for ultrasound navigation guidance
King’s College London(伦敦国王学院);Siemens Healthcare Limited(西门子医疗有限公司);Siemens Healthineers(西门子医疗);Siemens Healthineers AG(西门子医疗股份公司);Carol Davila University of Medicine and Pharmacy Bucharest(布加勒斯特卡罗尔·达维拉医药大学);Fortis Institute of Medical Sciences(富蒂斯医学院);Guy’s and St Thomas’ NHS Foundation Trust(盖伊和圣托马斯国民保健信托基金)
VesNet-RL: Simulation-based Reinforcement Learning for Real-World US Probe Navigation
Technical University of Munich(慕尼黑工业大学);Shanghai Jiao Tong University(上海交通大学);Helmholtz Zentrum München(慕尼黑亥姆霍兹中心);rechts der Isar University Hospital(伊萨尔河右岸大学医院)
Uncertainty-aware Diffusion and Reinforcement Learning for Joint Plane Localization and Anomaly Diagnosis in 3D Ultrasound
Medical Ultrasound Image Computing (MUSIC) Lab, School of Biomedical Engineering, Medical School, Shenzhen University, Shenzhen, China The People’s Hospital of Guangxi Zhuang Autonomous Region, Nanning, China Centre for CIMIM, Manchester University, Manchester, UK School of Artificial Intelligence, Shenzhen University, Shenzhen, China National Engineering Laboratory for Big Data System Computing Technology, Shenzhen University, Shenzhen, China School of Biomedical Engineering;Informatics, Nanjing Medical University, Nanjing, China
US-VLA: An Ultrasound Vision-Language-Action Model for Embodied Abdomina
Faculty of Computer Science and Technology, Ocean University of China(中国海洋大学计算机科学与技术学院);School of Information Science and Engineering, Shandong University(山东大学信息科学与工程学院);the Qilu Second Hospital of Shandong University(山东大学第二齐鲁医院);Innovation School of Artificial Intelligence, Hefei University of Technology(合肥工业大学人工智能创新学院)
End-to-End Framework Integrating Generative AI and Deep Reinforcement Learning for Autonomous Ultrasound Scanning
organization= Concordia Institute for Information Systems Engineering, Concordia University , city= Montreal , country= Canada;organization= Department of Mechanical, Industrial;Aerospace Engineering, Concordia University , city= Montreal , country= Canada;organization= Department of Medicine, Laval University , city= Quebec , country= Canada;organization= Department of Electrical, Computer;Software Engineering, Ontario Tech University , city= Oshawa , country= Canada;organization= Department of Computer Science, Khalifa University , city= Abu Dhabi , country= UAE;organization= Artificial Intelligence \& Cyber Systems Research Center, Department of CSM, Lebanese American University , city= Beirut , country= Lebanon;organization= Department of Electrical Engineering;Computer Science, Khalifa University , city= Abu Dhabi , country= UAE
Epistemic-aware Vision-Language Foundation Model for Fetal Ultrasound Interpretation
National Engineering Research Center for Multimedia Software, School of Computer Science, Wuhan University(国家多媒体软件工程技术研究中心,武汉大学计算机学院);College of Computing and Data Science, Nanyang Technological University(computing and Data Science学院,南洋理工大学)
PRECISE-AS: Personalized Reinforcement Learning for Efficient Point-of-Care Echocardiography in Aortic Stenosis Diagnosis
Department of Electrical and Computer Engineering, The University of British Columbia(电气与计算机工程系,不列颠哥伦比亚大学);Department of Computer Science, The University of British Columbia(计算机科学系,不列颠哥伦比亚大学);Vancouver General Hospital(温哥华总医院)