arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2109.06346eess.IVcs.CVcs.LG
收藏

物理驱动的具有注意机制的结构域特异性转运蛋白超声成像框架

Physics Driven Domain Specific Transporter Framework with Attention Mechanism for Ultrasound Imaging

Indian Institute of Technology Palakkad(印度理工学院帕拉卡德分校);University of Alberta(阿尔伯塔大学);Hospital Universitario Puerta de Hierro(铁门大学医院);Government Medical College Thiruvananthapuram(特里凡得琅政府医学院);Sree Chitra Tirunal Institute for Medical Sciences & Technology(斯里奇特拉蒂鲁纳尔医学科学与技术研究所)
Arpan Tripathi, Abhilash Rakkunedeth, Mahesh Raveendranatha Panicker, Jack Zhang, Naveenjyote Boora, Jessica Knight, Jacob Jaremko, Yale Tung Chen, Kiran Vishnu… 展开作者

Arpan Tripathi, Abhilash Rakkunedeth, Mahesh Raveendranatha Panicker, Jack Zhang, Naveenjyote Boora, Jessica Knight, Jacob Jaremko, Yale Tung Chen, Kiran Vishnu Narayan, Kesavadas C

摘要:

深度学习技术在医学成像中的大多数应用都是有监督的,需要大量的标记数据,这是昂贵的,需要专家花费许多小时仔细注释。在本文中,我们提出了一个无监督的,物理驱动的领域特定的运输框架与注意力机制,以确定相关的关键点与超声成像中的应用。所提出的框架确定关键点,提供了一个简洁的几何表示,突出显示区域的超声视频中的高结构变化。我们将物理驱动的领域特定的信息作为一个功能的概率图,并使用氡变换突出功能在特定的方向。所提出的框架已经在130个肺部超声(LUS)视频和113个腕部超声(WUS)视频上进行了训练,并在从全球多个中心采集的100个肺部超声(LUS)视频和58个腕部超声(WUS)视频上进行了验证。来自两个数据集的图像由专家独立评估,以识别临床相关特征,例如来自LUS的A线、B线和胸膜以及来自WUS视频的桡骨干骺端、桡骨骨骺和腕骨。从两个数据集中检测到的关键点在检测专家识别的图像标志时显示出高灵敏度(LUS = 99%,WUS = 74%)。此外,在采用的给定的肺图像的分类成正常和异常类,所提出的方法,即使没有事先训练,达到了97%的平均准确率和95%的平均F1分数分别对3折交叉验证的共同分类任务。由于所提出的方法具有纯粹的无监督性质,我们希望关键点检测方法能够增加超声在紧急情况和护理点进行的各种检查中的适用性。

英文摘要:

Most applications of deep learning techniques in medical imaging are supervised and require a large number of labeled data which is expensive and requires many hours of careful annotation by experts. In this paper, we propose an unsupervised, physics driven domain specific transporter framework with an attention mechanism to identify relevant key points with applications in ultrasound imaging. The proposed framework identifies key points that provide a concise geometric representation highlighting regions with high structural variation in ultrasound videos. We incorporate physics driven domain specific information as a feature probability map and use the radon transform to highlight features in specific orientations. The proposed framework has been trained on130 Lung ultrasound (LUS) videos and 113 Wrist ultrasound (WUS) videos and validated on 100 Lung ultrasound (LUS) videos and 58 Wrist ultrasound (WUS) videos acquired from multiple centers across the globe. Images from both datasets were independently assessed by experts to identify clinically relevant features such as A-lines, B-lines and pleura from LUS and radial metaphysis, radial epiphysis and carpal bones from WUS videos. The key points detected from both datasets showed high sensitivity (LUS = 99\% , WUS = 74\%) in detecting the image landmarks identified by experts. Also, on employing for classification of the given lung image into normal and abnormal classes, the proposed approach, even with no prior training, achieved an average accuracy of 97\% and an average F1-score of 95\% respectively on the task of co-classification with 3 fold cross-validation. With the purely unsupervised nature of the proposed approach, we expect the key point detection approach to increase the applicability of ultrasound in various examination performed in emergency and point of care.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑