arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2010.15316cs.CLcs.LG
收藏

根据临床文本的多发性硬化严重程度分类

Multiple Sclerosis Severity Classification From Clinical Text

University of Toronto(多伦多大学);Unity Health Toronto(联合健康多伦多);Vector Institute(向量研究所);Ontario Institute for Cancer Research(安大略癌症研究所);Toronto Rehabilitation Institute(多伦多康复研究所);Bloorview Research Institute(布洛尔维尤研究所)

Alister D Costa, Stefan Denkovski, Michal Malyska, Sae Young Moon, Brandon Rufino, Zhen Yang, Taylor Killian, Marzyeh Ghassemi

摘要:

多发性硬化症(MS)是一种慢性、炎性和退行性神经系统疾病,由专家使用扩展残疾状态量表(EDSS)进行监测,并以神经科会诊记录的形式记录在非结构化文本中。EDSS测量包含总体“EDSS”评分和几个功能分项评分。通常,需要专家知识来解释咨询笔记并生成这些分数。以前的方法使用有限的上下文长度Word 2 Vec嵌入和关键字搜索来预测参考笔记的分数,但当分数没有明确说明时往往会失败。在这项工作中,我们提出了MS-BERT,第一个公开可用的Transformer模型训练的真实临床数据以外的MIMIC。接下来,我们介绍了MSBC,一个应用MS-BERT生成嵌入并预测EDSS和功能子分数的分类器。最后,我们探索通过使用Snorkel将MSBC与其他模型相结合,为未标记的咨询笔记生成分数。MSBC在所有指标和预测任务上都达到了最先进的性能,并且优于从Snorkel集合生成的模型。与以前的Word 2 Vec CNN和基于规则的方法相比,我们将Macro-F1提高了0.12(至0.88)用于预测EDSS,平均提高了0.29(至0.63)用于预测功能子分数。

英文摘要:

Multiple Sclerosis (MS) is a chronic, inflammatory and degenerative neurological disease, which is monitored by a specialist using the Expanded Disability Status Scale (EDSS) and recorded in unstructured text in the form of a neurology consult note. An EDSS measurement contains an overall "EDSS" score and several functional subscores. Typically, expert knowledge is required to interpret consult notes and generate these scores. Previous approaches used limited context length Word2Vec embeddings and keyword searches to predict scores given a consult note, but often failed when scores were not explicitly stated. In this work, we present MS-BERT, the first publicly available transformer model trained on real clinical data other than MIMIC. Next, we present MSBC, a classifier that applies MS-BERT to generate embeddings and predict EDSS and functional subscores. Lastly, we explore combining MSBC with other models through the use of Snorkel to generate scores for unlabelled consult notes. MSBC achieves state-of-the-art performance on all metrics and prediction tasks and outperforms the models generated from the Snorkel ensemble. We improve Macro-F1 by 0.12 (to 0.88) for predicting EDSS and on average by 0.29 (to 0.63) for predicting functional subscores over previous Word2Vec CNN and rule-based approaches.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑