arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2511.17828cs.CVcs.AI

迈向可解释AI方法的乳腺成像:适应基础模型以适应多样化人群

Toward explainable AI approaches for breast imaging: adapting foundation models to diverse populations

University of Pennsylvania(宾夕法尼亚大学);Federal University of Paraíba(帕拉州联邦大学);University of Bristol(布里斯托大学)
Guilherme J. Cavalcante, José Gabriel A. Moreira, Gabriel A. B. do Nascimento, Vincent Dong, Alex Nguyen, Thaís G. do Rêgo, Yuri Malheiros, Telmo M. Silva Filho… 展开作者

Guilherme J. Cavalcante, José Gabriel A. Moreira, Gabriel A. B. do Nascimento, Vincent Dong, Alex Nguyen, Thaís G. do Rêgo, Yuri Malheiros, Telmo M. Silva Filho, Carla R. Zeballos Torrez, James C. Gee, Anne Marie McCarthy, Andrew D. A. Maidment, Bruno Barufaldi

AI总结:

本研究利用BiomedCLIP基础模型,通过多模态训练提升乳腺密度分类的准确性和泛化能力,验证了其在不同成像模态中的鲁棒性和可解释性。

摘要:

基础模型在专门的医学成像任务中具有潜力,尽管其在乳腺成像中的有效性仍待探索。本研究利用BiomedCLIP作为基础模型来解决模型泛化性方面的挑战。BiomedCLIP被适配用于自动BI-RADS乳腺密度分类,使用多模态乳腺X线摄影数据(合成2D图像、数字乳腺摄影和数字乳腺断层摄影)。利用96,995张图像,我们比较了单模态(仅s2D)和多模态训练方法,通过加权对比学习解决类别不平衡问题。两种方法均取得了相似的准确率(多模态:0.74,单模态:0.73),多模态模型在不同成像模态中的适用性更广,且在BI-RADS类别中AUC值始终高于0.84。在RSNA和EMBED数据集上的外部验证显示了强大的泛化能力(AUC范围:0.80-0.93)。GradCAM可视化确认了一致且临床相关的关注模式,突显了模型的可解释性和鲁棒性。本研究强调了基础模型在乳腺成像应用中的潜力,为未来诊断任务的扩展铺平了道路。

英文摘要:

Foundation models hold promise for specialized medical imaging tasks, though their effectiveness in breast imaging remains underexplored. This study leverages BiomedCLIP as a foundation model to address challenges in model generalization. BiomedCLIP was adapted for automated BI-RADS breast density classification using multi-modality mammographic data (synthesized 2D images, digital mammography, and digital breast tomosynthesis). Using 96,995 images, we compared single-modality (s2D only) and multi-modality training approaches, addressing class imbalance through weighted contrastive learning. Both approaches achieved similar accuracy (multi-modality: 0.74, single-modality: 0.73), with the multi-modality model offering broader applicability across different imaging modalities and higher AUC values consistently above 0.84 across BI-RADS categories. External validation on the RSNA and EMBED datasets showed strong generalization capabilities (AUC range: 0.80-0.93). GradCAM visualizations confirmed consistent and clinically relevant attention patterns, highlighting the models interpretability and robustness. This research underscores the potential of foundation models for breast imaging applications, paving the way for future extensions for diagnostic tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑