arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2005.09531cs.CV
收藏

基于深度强化学习的超声视频摘要

Ultrasound Video Summarization using Deep Reinforcement Learning

Imperial College London(帝国理工学院)

Tianrui Liu, Qingjie Meng, Athanasios Vlontzos, Jeremy Tan, Daniel Rueckert, Bernhard Kainz

摘要:

视频是用于诊断的基本成像模态,例如在超声成像中,用于内窥镜检查或运动评估。然而,视频在医学图像分析界并没有得到太多的关注。在临床实践中,有效地利用原始诊断视频数据是具有挑战性的,因为视频数据需要很长时间来处理、注释或审核。在本文中,我们介绍了一种新的,全自动的视频摘要方法,是针对医疗视频数据的需求。我们的方法被框定为强化学习问题,并产生代理专注于保存重要的诊断信息。我们评估我们的方法对胎儿超声筛查的视频,其中通常只有少量的记录数据用于诊断。我们表明,我们的方法优于其他视频摘要方法,它保留了临床诊断标准所需的基本信息。

英文摘要:

Video is an essential imaging modality for diagnostics, e.g. in ultrasound imaging, for endoscopy, or movement assessment. However, video hasn't received a lot of attention in the medical image analysis community. In the clinical practice, it is challenging to utilise raw diagnostic video data efficiently as video data takes a long time to process, annotate or audit. In this paper we introduce a novel, fully automatic video summarization method that is tailored to the needs of medical video data. Our approach is framed as reinforcement learning problem and produces agents focusing on the preservation of important diagnostic information. We evaluate our method on videos from fetal ultrasound screening, where commonly only a small amount of the recorded data is used diagnostically. We show that our method is superior to alternative video summarization methods and that it preserves essential information required by clinical diagnostic standards.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑