arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1909.03039cs.LGcs.CLstat.ML
收藏

基于临床笔记的语言模型预训练改进的分层患者分类

Improved Hierarchical Patient Classification with Language Model Pretraining over Clinical Notes

Google Health(谷歌健康)

Jonas Kemp, Alvin Rajkomar, Andrew M. Dai

摘要:

电子健康记录中的临床记录包含高度异质的书写风格,包括非标准术语或缩写。在预测建模中使用这些注释传统上需要预处理(例如,获取频繁术语或主题建模),这会去除源数据的大部分丰富性。我们提出了一个预训练的分层递归神经网络模型,该模型以直观的方式解析最小化处理的临床笔记,并表明与将笔记视为无序术语集合或不进行预训练的模型相比,它提高了重症监护医学信息市场III(MIMIC-III)数据集上出院诊断分类任务的性能。我们还将归因技术应用于示例,以识别模型用于进行预测的单词,并显示单词附近上下文的重要性。

英文摘要:

Clinical notes in electronic health records contain highly heterogeneous writing styles, including non-standard terminology or abbreviations. Using these notes in predictive modeling has traditionally required preprocessing (e.g. taking frequent terms or topic modeling) that removes much of the richness of the source data. We propose a pretrained hierarchical recurrent neural network model that parses minimally processed clinical notes in an intuitive fashion, and show that it improves performance for discharge diagnosis classification tasks on the Medical Information Mart for Intensive Care III (MIMIC-III) dataset, compared to models that treat the notes as an unordered collection of terms or that conduct no pretraining. We also apply an attribution technique to examples to identify the words that the model uses to make its prediction, and show the importance of the words' nearby context.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑