arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2310.06552cs.AIcs.CL
收藏

使用现成大型语言模型实现自动化临床编码

Automated clinical coding using off-the-shelf large language models

Canon Medical Research Europe(佳能医疗研究欧洲);Queen Mary University of London(伦敦玛丽女王大学);University of Edinburgh(爱丁堡大学);Anglia Ruskin University(安格利亚鲁斯金大学);The Alan Turing Institute(艾伦·图灵研究所);University of Warwick(华威大学)

Joseph S. Boyle, Antanas Kascenas, Pat Lok, Maria Liakata, Alison Q. O'Neil

AI总结:

本研究利用现成大型语言模型,通过信息提取和层次化稀疏搜索,实现零样本与少样本的自动化ICD临床编码,无需任务特定训练。

摘要:

为患者住院分配诊断性ICD编码的任务通常由专业的人类编码员执行。自动化ICD编码的努力主要由监督式深度学习模型主导。然而,学习预测大量罕见编码的困难仍然是临床实践采用的一个障碍。在这项工作中,我们利用现成的预训练生成式大型语言模型(LLMs)开发了一种实用的解决方案,适用于零样本和少样本编码分配,无需进一步的任务特定训练。仅靠无监督预训练并不能保证对ICD本体论和专业临床编码任务的精确知识,因此我们将该任务构建为信息提取,提供每个编码概念的描述,并让模型检索相关提及。为了提高效率,我们不是遍历所有编码,而是利用ICD本体论的层次结构来稀疏搜索相关编码。

英文摘要:

The task of assigning diagnostic ICD codes to patient hospital admissions is typically performed by expert human coders. Efforts towards automated ICD coding are dominated by supervised deep learning models. However, difficulties in learning to predict the large number of rare codes remain a barrier to adoption in clinical practice. In this work, we leverage off-the-shelf pre-trained generative large language models (LLMs) to develop a practical solution that is suitable for zero-shot and few-shot code assignment, with no need for further task-specific training. Unsupervised pre-training alone does not guarantee precise knowledge of the ICD ontology and specialist clinical coding task, therefore we frame the task as information extraction, providing a description of each coded concept and asking the model to retrieve related mentions. For efficiency, rather than iterating over all codes, we leverage the hierarchical nature of the ICD ontology to sparsely search for relevant codes.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑