arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.09324cs.CLcs.AI
收藏

大型语言模型的高效微调用于自动化医疗文档

Efficient Fine-Tuning of Large Language Models for Automated Medical Documentation

Data Science Institute, University of Chicago(芝加哥大学数据科学研究所)

Hui Yi Leong, Yi Fan Gao, Ji Shuai, Yang Zhang, Uktu Pamuksuz

AI总结:

本研究提出MediGen,通过微调LLaMA3-8B模型自动生成医疗报告,以减轻医生行政负担,实验显示ROUGE达58%,BERTScore-F1达72%,有效提升效率与福祉。

摘要:

科学研究表明,医生每花一小时在直接患者护理上,就需额外花费近两小时在行政任务上,尤其是电子健康记录(EHR)和文书工作。这种过重的行政负担不仅减少了可用于患者护理的时间,还导致医生倦怠和医疗交付效率低下。为应对这些挑战,本研究引入了MediGen,一个经过微调的大型语言模型(LLM),旨在从医疗对话中自动生成医疗报告。通过利用最先进的方法对开源预训练模型(包括LLaMA3-8B)进行微调,MediGen在转录和总结临床互动方面实现了高准确性。微调后的LLaMA3-8B模型展示了令人鼓舞的结果,达到了58%的ROUGE分数和72%的BERTScore-F1,表明其在生成准确且临床相关的医疗报告方面的有效性。这些发现表明,MediGen有潜力显著减少医生的行政工作量,提高医疗效率和医生福祉。

英文摘要:

Scientific research indicates that for every hour spent in direct patient care, physicians spend nearly two additional hours on administrative tasks, particularly on electronic health records (EHRs) and desk work. This excessive administrative burden not only reduces the time available for patient care but also contributes to physician burnout and inefficiencies in healthcare delivery. To address these challenges, this study introduces MediGen, a fine-tuned large language model (LLM) designed to automate the generation of medical reports from medical dialogues. By leveraging state-of-the-art methodologies for fine-tuning open-source pretrained models, including LLaMA3-8B, MediGen achieves high accuracy in transcribing and summarizing clinical interactions. The fine-tuned LLaMA3-8B model demonstrated promising results, achieving a ROUGE score of 58% and a BERTScore-F1 of 72%, indicating its effectiveness in generating accurate and clinically relevant medical reports. These findings suggest that MediGen has the potential to significantly reduce the administrative workload on physicians, improving both healthcare efficiency and physician well-being.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑