arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2411.05042cs.CLcs.AI
收藏

通过本地大语言模型提升放射学报告的简洁性与结构性

Improving Radiology Report Conciseness and Structure via Local Large Language Models

Department of Machine Learning, H. Lee Moffitt Cancer Center & Research Institute(机器学习系,H. Lee Moffitt癌症中心与研究所在读机构);Deparmtent of Diagnostic Imaging & Interventional Radiology, H. Lee Moffitt Cancer Center & Research Institute(诊断影像与介入放射学系,H. Lee Moffitt癌症中心与研究所在读机构);Department of Radiology, James A. Haley VA Hospital(放射学系,James A. Haley退伍军人医院)

Iryna Hartsock, Cyrillo Araujo, Les Folio, Ghulam Rasool

AI总结:

本研究利用本地部署的Mixtral大语言模型,通过先压缩后结构化格式的提示策略处理814份放射学报告,将冗余词数减少53%以上,验证了开源LLMs在提升报告简洁性与临床工作流程效率方面的潜力。

摘要:

放射学报告通常冗长且缺乏结构,给转诊医生快速识别关键影像发现带来挑战,同时增加了信息遗漏的风险。本回顾性研究旨在通过使报告简洁且结构良好、按相关器官组织发现内容来改进放射学报告。为实现这一目标,我们使用了部署在本机构防火墙内部的私有大语言模型(LLMs),以确保数据安全并最小化计算成本。利用来自莫菲特癌症中心七位经委员会认证的体部放射科医生的814份放射学报告数据集,我们在LangChain框架内测试了五种提示策略。在评估多个模型后,Mixtral LLM在格式要求遵守方面表现优于Llama等替代模型。最优策略涉及先压缩报告,再根据具体指令应用结构化格式,从而在提高清晰度的同时减少冗长。在所有放射科医生和报告中,Mixtral LLM将冗余词数减少了53%以上。这些发现凸显了本地部署的开源LLMs在简化放射学报告流程方面的潜力。通过生成简洁、结构良好的报告,这些模型增强了信息检索能力,更好地满足了转诊医生的需求,最终改善了临床工作流程。

英文摘要:

Radiology reports are often lengthy and unstructured, posing challenges for referring physicians to quickly identify critical imaging findings while increasing the risk of missed information. This retrospective study aimed to enhance radiology reports by making them concise and well-structured, with findings organized by relevant organs. To achieve this, we utilized private large language models (LLMs) deployed locally within our institution's firewall, ensuring data security and minimizing computational costs. Using a dataset of 814 radiology reports from seven board-certified body radiologists at Moffitt Cancer Center, we tested five prompting strategies within the LangChain framework. After evaluating several models, the Mixtral LLM demonstrated superior adherence to formatting requirements compared to alternatives like Llama. The optimal strategy involved condensing reports first and then applying structured formatting based on specific instructions, reducing verbosity while improving clarity. Across all radiologists and reports, the Mixtral LLM reduced redundant word counts by more than 53%. These findings highlight the potential of locally deployed, open-source LLMs to streamline radiology reporting. By generating concise, well-structured reports, these models enhance information retrieval and better meet the needs of referring physicians, ultimately improving clinical workflows.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑