arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2307.09018q-bio.QMcs.LG
收藏

基于个体特异性数据的健康领域多模态大语言模型

Multimodal LLMs for health grounded in individual-specific data

Google Research(谷歌研究院)

Anastasiya Belyaeva, Justin Cosentino, Farhad Hormozdiari, Krish Eswaran, Shravya Shetty, Greg Corrado, Andrew Carroll, Cory Y. McLean, Nicholas A. Furlotte

AI总结:

本研究提出健康多模态理解大语言模型框架HeLM,通过编码高维临床模态等数据实现疾病风险评估,在UK Biobank数据上表现优于或持平经典机器学习方法,还可支持健康对话等下游应用。

摘要:

基础大语言模型(LLMs)已展现出解决包括健康在内的广泛领域任务的出色能力。为有效解决个性化健康任务,LLMs需要具备处理与个体健康状态相关的多种数据模态的能力。本文提出一种面向健康领域、基于个体特异性数据的多模态LLMs构建方案,开发了HeLM(健康多模态理解大语言模型)框架,该框架使LLMs能够利用高维临床模态评估潜在疾病风险。HeLM通过学习将复杂数据模态映射到LLM词元嵌入空间的编码器来对其进行编码,对于表格数据这类简单模态,则将数据序列化为文本进行处理。利用UK Biobank(英国生物银行)的数据,我们证明HeLM除高维时间序列数据外,还能有效利用人口统计学和临床特征评估疾病风险。例如,在结合表格数据和肺量计数据模态时,HeLM在哮喘预测任务上的AUROC达到0.75,而仅使用表格数据时AUROC为0.49。总体而言,我们发现在选定的8种二分类性状上,HeLM的表现优于经典机器学习方法或与之相当。此外,我们还探究了该模型的下游应用,比如其对分布外性状的泛化能力,以及支持围绕个体健康与保健开展对话的能力。

英文摘要:

Foundation large language models (LLMs) have shown an impressive ability to solve tasks across a wide range of fields including health. To effectively solve personalized health tasks, LLMs need the ability to ingest a diversity of data modalities that are relevant to an individual's health status. In this paper, we take a step towards creating multimodal LLMs for health that are grounded in individual-specific data by developing a framework (HeLM: Health Large Language Model for Multimodal Understanding) that enables LLMs to use high-dimensional clinical modalities to estimate underlying disease risk. HeLM encodes complex data modalities by learning an encoder that maps them into the LLM's token embedding space and for simple modalities like tabular data by serializing the data into text. Using data from the UK Biobank, we show that HeLM can effectively use demographic and clinical features in addition to high-dimensional time-series data to estimate disease risk. For example, HeLM achieves an AUROC of 0.75 for asthma prediction when combining tabular and spirogram data modalities compared with 0.49 when only using tabular data. Overall, we find that HeLM outperforms or performs at parity with classical machine learning approaches across a selection of eight binary traits. Furthermore, we investigate the downstream uses of this model such as its generalizability to out-of-distribution traits and its ability to power conversations around individual health and wellness.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑