临床笔记的有效表达
Effective Representations of Clinical Notes
摘要:
临床笔记是关于患者状态的丰富信息来源。然而,使用它们来预测具有机器学习模型的临床事件是具有挑战性的。它们是非常高维的,稀疏的,具有复杂的结构。此外,训练数据通常是稀缺的,因为获得许多临床事件的可靠标签是昂贵的。传统上,这些困难都是通过人工特征工程编码任务特定的领域知识来解决的。我们探索了使用神经网络和迁移学习来学习临床笔记的表示,这些笔记对预测未来感兴趣的临床事件有用,例如全因死亡率,住院和急诊室就诊。我们的数据包括270万张笔记和斯坦福医院的11.5万名患者。我们使用学习的表示,以及常用的词袋和主题模型表示,作为临床事件预测模型的特征。我们评估了这些表示在小数据集上训练的模型性能方面的有效性。使用神经网络衍生表示的模型比使用小($N < 1000$)训练数据集的基线表示的模型表现得更好。对于一系列预测建模任务和队列大小,学习的表示比常用的基线表示提供了显着的性能增益,当大量标记的训练数据不可用时,为特定于任务的特征工程提供了有效的替代方案。
英文摘要:
Clinical notes are a rich source of information about patient state. However, using them to predict clinical events with machine learning models is challenging. They are very high dimensional, sparse and have complex structure. Furthermore, training data is often scarce because it is expensive to obtain reliable labels for many clinical events. These difficulties have traditionally been addressed by manual feature engineering encoding task specific domain knowledge. We explored the use of neural networks and transfer learning to learn representations of clinical notes that are useful for predicting future clinical events of interest, such as all causes mortality, inpatient admissions, and emergency room visits. Our data comprised 2.7 million notes and 115 thousand patients at Stanford Hospital. We used the learned representations, along with commonly used bag of words and topic model representations, as features for predictive models of clinical events. We evaluated the effectiveness of these representations with respect to the performance of the models trained on small datasets. Models using the neural network derived representations performed significantly better than models using the baseline representations with small ($N < 1000$) training datasets. The learned representations offer significant performance gains over commonly used baseline representations for a range of predictive modeling tasks and cohort sizes, offering an effective alternative to task specific feature engineering when plentiful labeled training data is not available.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。