DeepDRR --透视引导手术中机器学习的催化剂
DeepDRR -- A Catalyst for Machine Learning in Fluoroscopy-guided Procedures
摘要:
基于机器学习的方法在与诊断放射学相关的大多数学科中优于竞争方法。然而,介入放射学尚未从深度学习的出现中获益,特别是因为两个原因:1)在手术过程中获取的大多数图像从未存档,因此无法用于学习,以及2)即使它们可用,由于数据量巨大,注释也将是一个严峻的挑战。当考虑透视引导手术时,真正介入透视的一个有趣的替代方案是来自3D诊断CT的手术的计算机模拟。在这种情况下,标记是非常容易的,并且可能容易获得,然而,所得到的合成数据的适当性取决于正演模型。在这项工作中,我们提出了DeepDRR,这是一种用于快速逼真地模拟CT扫描的荧光透视和数字X射线摄影的框架,与深度学习原生的软件平台紧密集成。我们使用机器学习分别在3D和2D中进行材料分解和散射估计,并结合解析前向投影和噪声注入来实现所需的性能。以骨盆X射线图像中的解剖标志检测为例,我们证明了在DeepDRR上训练的机器学习模型可以推广到看不见的临床采集数据,而无需重新训练或域适应。我们的研究结果是有希望的,并促进建立机器学习的荧光透视引导程序。
英文摘要:
Machine learning-based approaches outperform competing methods in most disciplines relevant to diagnostic radiology. Interventional radiology, however, has not yet benefited substantially from the advent of deep learning, in particular because of two reasons: 1) Most images acquired during the procedure are never archived and are thus not available for learning, and 2) even if they were available, annotations would be a severe challenge due to the vast amounts of data. When considering fluoroscopy-guided procedures, an interesting alternative to true interventional fluoroscopy is in silico simulation of the procedure from 3D diagnostic CT. In this case, labeling is comparably easy and potentially readily available, yet, the appropriateness of resulting synthetic data is dependent on the forward model. In this work, we propose DeepDRR, a framework for fast and realistic simulation of fluoroscopy and digital radiography from CT scans, tightly integrated with the software platforms native to deep learning. We use machine learning for material decomposition and scatter estimation in 3D and 2D, respectively, combined with analytic forward projection and noise injection to achieve the required performance. On the example of anatomical landmark detection in X-ray images of the pelvis, we demonstrate that machine learning models trained on DeepDRRs generalize to unseen clinically acquired data without the need for re-training or domain adaptation. Our results are promising and promote the establishment of machine learning in fluoroscopy-guided procedures.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。