大型语言模型利用多模态数据改进阿尔茨海默病诊断
Large language models improve Alzheimer's disease diagnosis using multi-modality data
- Zhejiang University(浙江大学)
- Stony Brook University(石溪大学)
- Brigham and Women’s Hospital(布莱根妇女医院)
- Harvard Medical School(哈佛医学院)
机构由 AI 辅助整理,请以论文原文为准。
AI总结:
本文提出利用预训练大型语言模型增强对非影像患者数据的利用能力,以改进阿尔茨海默病诊断,并在ADNI数据集上取得了SOTA结果。
AI中文摘要:
在诊断阿尔茨海默病(AD)等具有挑战性的疾病时,影像是重要的参考依据。患者信息、遗传数据、用药信息、认知和记忆测试等非影像患者数据在诊断中也发挥着非常重要的作用。然而,受限于人工智能模型挖掘此类信息的能力,现有模型大多仅使用多模态影像数据,无法充分利用非影像数据。我们使用当前非常流行的预训练大型语言模型(LLM)来增强模型利用非影像数据的能力,并在ADNI数据集上取得了SOTA结果。
英文摘要:
In diagnosing challenging conditions such as Alzheimer's disease (AD), imaging is an important reference. Non-imaging patient data such as patient information, genetic data, medication information, cognitive and memory tests also play a very important role in diagnosis. Effect. However, limited by the ability of artificial intelligence models to mine such information, most of the existing models only use multi-modal image data, and cannot make full use of non-image data. We use a currently very popular pre-trained large language model (LLM) to enhance the model's ability to utilize non-image data, and achieved SOTA results on the ADNI dataset.