arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2606.02487cs.CL
收藏

迈向多学科住院总结:高效的句子级临床来源分类

Towards Multidisciplinary Summarization of Hospital Stays: Efficient Sentence-Level Clinical Provenance Categorization

University of Illinois Chicago(伊利诺伊大学芝加哥分校);University of Iowa(爱荷华大学);University of Missouri-Columbia(密苏里大学哥伦比亚分校)
Baris Karacan, Vaibhav Bhargava, Barbara Di Eugenio, Natalie Parde, Mary Khetani, Yu-Shan Tseng, Vanessa Barbosa, Julie Vignato, Lindsey Knake, Rajashree Dahal,… 展开作者

Baris Karacan, Vaibhav Bhargava, Barbara Di Eugenio, Natalie Parde, Mary Khetani, Yu-Shan Tseng, Vanessa Barbosa, Julie Vignato, Lindsey Knake, Rajashree Dahal, Emily Spellman, Danielle Hitzel, Janine Petitgout, Kristi Haughey, Amanda Karstens, Brianna Clarahan, Rachel Dawson, Lauren Boyd, Mackenzie Weis, Angie Tipton, Jaewon Bae, Catherine K. Craven, Karen Dunn Lopez, Andrew D. Boyd

AI总结:

本研究提出一个基于大语言模型监督微调的临床来源分类流水线,用于多学科住院总结,通过量化70B模型在跨领域迁移中提升F1分数7%,并证明模型容量对语义灵活性的关键作用。

摘要:

在新生儿重症监护室(NICU)等高复杂性环境中,有效的“全团队”总结需要聚合来自不同学科(医生、护士、治疗师)的见解,这些见解分散在数百份临床自由文本记录中。简单地将异质文本汇集在一起往往会导致输出不连贯。因此,结构化总结首先需要对跨多源记录的句子级来源进行准确分类。本初步研究引入了一个临床来源分类流水线,使用大语言模型(LLM)的监督微调(SFT)。我们将两个Llama-3模型(8B和70B)适配到MedSecId,这是一个包含2,002份MIMIC-III(成人ICU)记录并带有临床来源标题注释的语料库,两个模型在域内均实现了超过92%的宏F1分数。为了评估跨域泛化能力,我们评估了模型容量(8B vs. 70B)和量化在一个由来自三个多学科NICU总结的227个句子级跨度组成的金标准数据集上的表现。实验结果表明存在规模依赖的迁移效应:虽然SFT对8B模型仅产生边际变化,但显著改进了70B模型,使宏F1提高了7%。值得注意的是,量化微调的70B模型在显著降低计算需求的同时,超越了其全精度基线。这些发现表明,足够的模型容量对于在跨域临床迁移中保持语义灵活性至关重要,并且高效的量化适配可以为下游总结实现结构化来源建模。

英文摘要:

Effective "all-team" summarization in high-complexity settings like the Neonatal Intensive Care Unit (NICU) requires aggregating insights from diverse disciplines (physicians, nurses, therapists) spread across hundreds of clinical free-text notes. Simply pooling heterogeneous text often leads to incoherent outputs. Structured summarization therefore first requires accurate categorization of sentence-level provenance across multi-source notes. This pilot study introduces a clinical provenance categorization pipeline using supervised fine-tuning (SFT) of large language models (LLMs). We adapted two Llama-3 models (8B and 70B) to MedSecId, a corpus of 2,002 MIMIC-III (Adult ICU) notes annotated with clinical provenance headers, achieving in-domain Macro F1 scores above 92% for both models. To evaluate cross-domain generalization, we assessed model capacity (8B vs. 70B) and quantization on a gold-standard dataset of 227 sentence-level spans derived from three multi-disciplinary NICU summaries. Experimental results demonstrate a scale-dependent transfer effect: while SFT produced only marginal changes for the 8B model, it substantially improved the 70B model, increasing Macro F1 by 7%. Notably, the quantized fine-tuned 70B model outperformed its full-precision baseline while substantially reducing computational requirements. These findings suggest that sufficient model capacity is critical for preserving semantic flexibility during cross-domain clinical transfer and that efficient quantized adaptation can enable structured provenance modeling for downstream summarization.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑