arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.17900cs.CLcs.LG
收藏

数据与知识结合的威力:GPT-4o 是肺癌淋巴结转移预测中机器学习模型的有效解释器

The Power of Combining Data and Knowledge: GPT-4o is an Effective Interpreter of Machine Learning Models in Predicting Lymph Node Metastasis of Lung Cancer

Zhejiang Lab(之江实验室);Peking University Cancer Hospital and Institute(北京大学肿瘤医院暨肿瘤研究所);College of Biomedical Engineering and Instrumental Science, Zhejiang University(浙江大学生物医学工程与仪器科学学院)

Danqing Hu, Bing Liu, Xiaofeng Zhu, Nan Wu

AI总结:

本研究提出集成大语言模型医学知识与机器学习模式的肺癌淋巴结转移预测方法,通过GPT-4o结合患者数据与模型预测值调整估算并集成结果,显著提升预测性能,为临床预测提供新范式。

摘要:

淋巴结转移(LNM)是确定肺癌患者初始治疗方案的关键因素,但术前准确诊断 LNM 仍具挑战性。近年来,大语言模型(LLM)凭借出色的文本生成能力受到广泛关注。依托从海量语料中习得的丰富医学知识,LLM 能够估算临床问题的发生概率,但其性能历来不及数据驱动的机器学习模型。\n本文提出一种新型集成方法,将 LLM 习得的医学知识与机器学习模型识别的潜在模式相结合,以提升 LNM 预测性能。首先,我们利用患者数据构建了机器学习模型;随后设计了提示模板,将患者数据与机器学习模型的预测概率进行整合;接着指示由 OpenAI 开发的最先进 LLM——GPT-4o 先基于患者数据估算 LNM 发生概率,再利用机器学习模型的输出调整该估算值;最后,我们使用相同提示从 GPT-4o 获取三次输出,并将这些结果集成作为最终预测。\n采用所提方法,我们的模型在 LNM 预测中取得了 0.778 的 AUC 值和 0.426 的 AP 值,与基线机器学习模型相比,预测性能显著提升。实验结果表明,GPT-4o 能够有效利用自身医学知识与机器学习模型的预测概率,实现更准确的 LNM 预测。这些发现证明 LLM 可在临床风险预测任务中表现良好,为临床预测中整合医学知识与患者数据提供了新范式。

英文摘要:

Lymph node metastasis (LNM) is a crucial factor in determining the initial treatment for patients with lung cancer, yet accurate preoperative diagnosis of LNM remains challenging. Recently, large language models (LLMs) have garnered significant attention due to their remarkable text generation capabilities. Leveraging the extensive medical knowledge learned from vast corpora, LLMs can estimate probabilities for clinical problems, though their performance has historically been inferior to data-driven machine learning models. In this paper, we propose a novel ensemble method that combines the medical knowledge acquired by LLMs with the latent patterns identified by machine learning models to enhance LNM prediction performance. Initially, we developed machine learning models using patient data. We then designed a prompt template to integrate the patient data with the predicted probability from the machine learning model. Subsequently, we instructed GPT-4o, the most advanced LLM developed by OpenAI, to estimate the likelihood of LNM based on patient data and then adjust the estimate using the machine learning output. Finally, we collected three outputs from the GPT-4o using the same prompt and ensembled these results as the final prediction. Using the proposed method, our models achieved an AUC value of 0.778 and an AP value of 0.426 for LNM prediction, significantly improving predictive performance compared to baseline machine learning models. The experimental results indicate that GPT-4o can effectively leverage its medical knowledge and the probabilities predicted by machine learning models to achieve more accurate LNM predictions. These findings demonstrate that LLMs can perform well in clinical risk prediction tasks, offering a new paradigm for integrating medical knowledge and patient data in clinical predictions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑