arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2503.15664cs.CL
收藏

利用大型语言模型增强胰腺癌分期:检索增强生成的作用

Enhancing Pancreatic Cancer Staging with Large Language Models: The Role of Retrieval-Augmented Generation

Hisashi Johno, Yuki Johno, Akitomo Amakawa, Junichi Sato, Ryota Tozuka, Atsushi Komaba, Hiroaki Watanabe, Hiroki Watanabe, Chihiro Goto, Hiroyuki Morisaka, Hiro… 展开作者

Hisashi Johno, Yuki Johno, Akitomo Amakawa, Junichi Sato, Ryota Tozuka, Atsushi Komaba, Hiroaki Watanabe, Hiroki Watanabe, Chihiro Goto, Hiroyuki Morisaka, Hiroshi Onishi, Kazunori Nakamoto

AI总结:

利用RAG技术提升胰腺癌分期准确性,展示NotebookLM在临床诊断中的应用价值

摘要:

目的:检索增强生成(RAG)是一种通过从可靠的外部知识(REK)中检索相关信息来增强大型语言模型(LLMs)的功能和可靠性技术。RAG在放射学领域引起了关注,我们之前报道了具有RAG(RAG-LLM)的NotebookLM在肺癌分期中的实用性。然而,由于比较的LLM与NotebookLM的内部模型不同,仍不清楚其优势是源于RAG还是内在模型差异。为了更好地隔离RAG的影响并评估其在不同癌症中的实用性,我们比较了NotebookLM与其内部LLM Gemini 2.0 Flash在胰腺癌分期实验中的表现。材料和方法:日本胰腺癌分期指南的摘要被用作REK。我们比较了三个小组——REK+/RAG+(NotebookLM带REK)、REK+/RAG-(Gemini 2.0 Flash带REK)和REK-/RAG-(Gemini 2.0 Flash无REK)——在基于CT发现的100个虚构胰腺癌病例的分期中。分期标准包括TNM分类、局部侵袭因素和可切除性分类。在REK+/RAG+中,检索准确率是根据检索到的REK片段的充分性来量化的。结果:REK+/RAG+实现了70%的分期准确率,优于REK+/RAG-(38%)和REK-/RAG-(35%)。对于TNM分类,REK+/RAG+达到了80%的准确率,超过了REK+/RAG-(55%)和REK-/RAG-(50%)。此外,REK+/RAG+明确呈现了检索到的REK片段,实现了92%的检索准确率。结论:NotebookLM,一种具有RAG的LLM,在胰腺癌分期实验中优于其内部LLM Gemini 2.0 Flash,表明RAG可能提高LLM的分期准确性。此外,其检索和呈现REK片段的能力为医生提供了透明度,突显了其在临床诊断和分类中的适用性。

英文摘要:

Purpose: Retrieval-augmented generation (RAG) is a technology to enhance the functionality and reliability of large language models (LLMs) by retrieving relevant information from reliable external knowledge (REK). RAG has gained interest in radiology, and we previously reported the utility of NotebookLM, an LLM with RAG (RAG-LLM), for lung cancer staging. However, since the comparator LLM differed from NotebookLM's internal model, it remained unclear whether its advantage stemmed from RAG or inherent model differences. To better isolate RAG's impact and assess its utility across different cancers, we compared NotebookLM with its internal LLM, Gemini 2.0 Flash, in a pancreatic cancer staging experiment. Materials and Methods: A summary of Japan's pancreatic cancer staging guidelines was used as REK. We compared three groups - REK+/RAG+ (NotebookLM with REK), REK+/RAG- (Gemini 2.0 Flash with REK), and REK-/RAG- (Gemini 2.0 Flash without REK) - in staging 100 fictional pancreatic cancer cases based on CT findings. Staging criteria included TNM classification, local invasion factors, and resectability classification. In REK+/RAG+, retrieval accuracy was quantified based on the sufficiency of retrieved REK excerpts. Results: REK+/RAG+ achieved a staging accuracy of 70%, outperforming REK+/RAG- (38%) and REK-/RAG- (35%). For TNM classification, REK+/RAG+ attained 80% accuracy, exceeding REK+/RAG- (55%) and REK-/RAG- (50%). Additionally, REK+/RAG+ explicitly presented retrieved REK excerpts, achieving a retrieval accuracy of 92%. Conclusion: NotebookLM, a RAG-LLM, outperformed its internal LLM, Gemini 2.0 Flash, in a pancreatic cancer staging experiment, suggesting that RAG may improve LLM's staging accuracy. Furthermore, its ability to retrieve and present REK excerpts provides transparency for physicians, highlighting its applicability for clinical diagnosis and classification.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑