arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2106.07932cs.AI
收藏

根据出院总结预测医疗代码:使用序列关注度将文档转换为序列BERT

Medical Code Prediction from Discharge Summary: Document to Sequence BERT using Sequence Attention

NHN Diquest(NHN Diquest 公司)

Tak-Sung Heo, Yongmin Yoo, Yeongjoon Park, Byeong-Cheol Jo, Kyungsun Kim

摘要:

临床笔记是临床医生在患者就诊期间生成的非结构化文本。临床笔记通常附有一套来自国际疾病分类(ICD)的元数据代码。ICD编码是用于各种操作的重要编码,包括保险,报销,医疗诊断等,因此,快速准确地对ICD编码进行分类非常重要。然而,注释这些代码是昂贵和耗时的。因此,我们提出了一个模型的基础上双向编码器表示从Transformers(BERT)使用序列注意力的方法自动ICD代码分配。我们在重症监护医学信息集市III(MIMIC-III)基准数据集上评估了我们的方法。我们的模型实现了宏观平均F1:0.62898和微观平均F1:0.68555的性能,并且比使用MIMIC-III数据集的最先进模型的性能更好。本研究的贡献是提出一种可应用于文档的BERT使用方法和一种可捕捉文档中出现的重要序列信息的序列注意方法。

英文摘要:

Clinical notes are unstructured text generated by clinicians during patient encounters. Clinical notes are usually accompanied by a set of metadata codes from the International Classification of Diseases(ICD). ICD code is an important code used in various operations, including insurance, reimbursement, medical diagnosis, etc. Therefore, it is important to classify ICD codes quickly and accurately. However, annotating these codes is costly and time-consuming. So we propose a model based on bidirectional encoder representations from transformers (BERT) using the sequence attention method for automatic ICD code assignment. We evaluate our approach on the medical information mart for intensive care III (MIMIC-III) benchmark dataset. Our model achieved performance of macro-averaged F1: 0.62898 and micro-averaged F1: 0.68555 and is performing better than a performance of the state-of-the-art model using the MIMIC-III dataset. The contribution of this study proposes a method of using BERT that can be applied to documents and a sequence attention method that can capture important sequence in-formation appearing in documents.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑