arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.02936eess.IVcs.CV
收藏

放射组学引导的多模态自注意力网络用于乳腺MRI病理完全缓解预测

Radiomics-guided Multimodal Self-attention Network for Predicting Pathological Complete Response in Breast MRI

Sungkyunkwan University(成均馆大学);Institute for Basic Science(基础科学研究院)

Jonghun Kim, Hyunjin Park

AI总结:

本文提出一种放射组学引导的多模态自注意力网络,融合DCE MRI和ADC图像特征预测乳腺癌患者病理完全缓解,实验证明其性能优于基线方法。

摘要:

乳腺癌是女性中最常见的癌症,预测抗癌治疗后的病理完全缓解(pCR)对于患者预后和治疗个性化至关重要。深度学习在医学影像诊断中展现出潜力,尤其是在利用多种成像模态提高准确性方面。本研究提出一个模型,利用动态对比增强(DCE)磁共振成像(MRI)和表观扩散系数(ADC)图预测乳腺癌患者的pCR。放射组学特征是肿瘤区域已建立的手工特征,因此在医学图像分析中可能有用。我们的方法使用具有自注意力机制的编码器从DCE MRI和ADC中提取特征,并利用放射组学引导从肿瘤相关区域提取特征。我们的实验结果表明,与其他基线方法相比,我们的模型在预测pCR方面具有优越性能。

英文摘要:

Breast cancer is the most prevalent cancer among women and predicting pathologic complete response (pCR) after anti-cancer treatment is crucial for patient prognosis and treatment customization. Deep learning has shown promise in medical imaging diagnosis, particularly when utilizing multiple imaging modalities to enhance accuracy. This study presents a model that predicts pCR in breast cancer patients using dynamic contrast-enhanced (DCE) magnetic resonance imaging (MRI) and apparent diffusion coefficient (ADC) maps. Radiomics features are established hand-crafted features of the tumor region and thus could be useful in medical image analysis. Our approach extracts features from both DCE MRI and ADC using an encoder with a self-attention mechanism, leveraging radiomics to guide feature extraction from tumor-related regions. Our experimental results demonstrate the superior performance of our model in predicting pCR compared to other baseline methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑