arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.07296physics.med-phcs.AIcs.CV
收藏

大语言模型增强的放射治疗靶区自动勾画

Large Language Model-Augmented Auto-Delineation of Treatment Target Volume in Radiation Therapy

Stanford University(斯坦福大学);Massachusetts General Hospital(麻省总医院)

Praveenbalaji Rajendran, Yong Yang, Thomas R. Niedermayr, Michael Gensheimer, Beth Beadle, Quynh-Thu Le, Lei Xing, Xianjin Dai

AI总结:

针对放射治疗靶区手动勾画效率低、差异大且AI自动勾画精度不足的问题,提出融合大语言模型的Radformer网络,通过视觉语言注意力模块整合多模态特征,在头颈癌数据集上实现了优于现有模型的分割效果,具备临床应用潜力。

摘要:

放射治疗(RT)是癌症最有效的治疗手段之一,其疗效取决于靶区的精准勾画。然而,靶区勾画是一项综合性医疗决策,目前完全依赖人类专家的手动操作。手动勾画耗时费力,且存在观察者间差异。尽管人工智能(AI)技术的进步显著提升了正常组织的自动勾画能力,但放射治疗靶区的精准勾画仍是一大挑战。本研究提出一种基于视觉语言模型的放射治疗靶区自动勾画网络,命名为Radformer。Radformer采用分层视觉Transformer作为骨干网络,并引入大语言模型从临床数据中提取富含文本信息的特征。我们提出了视觉语言注意力模块(VLAM),用于整合视觉与语言特征,实现语言感知视觉编码(LAVE)。我们在包含2985名接受放射治疗的头颈癌患者的数据集上对Radformer进行了评估,采用戴斯相似系数(DSC)、交并比(IOU)和95%分位数豪斯多夫距离(HD95)等指标定量评估模型性能。结果表明,Radformer相较于其他现有最优模型具备更优异的分割性能,验证了其应用于放射治疗临床实践的潜力。

英文摘要:

Radiation therapy (RT) is one of the most effective treatments for cancer, and its success relies on the accurate delineation of targets. However, target delineation is a comprehensive medical decision that currently relies purely on manual processes by human experts. Manual delineation is time-consuming, laborious, and subject to interobserver variations. Although the advancements in artificial intelligence (AI) techniques have significantly enhanced the auto-contouring of normal tissues, accurate delineation of RT target volumes remains a challenge. In this study, we propose a visual language model-based RT target volume auto-delineation network termed Radformer. The Radformer utilizes a hierarichal vision transformer as the backbone and incorporates large language models to extract text-rich features from clinical data. We introduce a visual language attention module (VLAM) for integrating visual and linguistic features for language-aware visual encoding (LAVE). The Radformer has been evaluated on a dataset comprising 2985 patients with head-and-neck cancer who underwent RT. Metrics, including the Dice similarity coefficient (DSC), intersection over union (IOU), and 95th percentile Hausdorff distance (HD95), were used to evaluate the performance of the model quantitatively. Our results demonstrate that the Radformer has superior segmentation performance compared to other state-of-the-art models, validating its potential for adoption in RT practice.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑