arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2209.00470cs.CLcs.IRcs.LGstat.ML
收藏

荷兰临床文本中的否定检测:基于规则和机器学习方法的评估

Negation detection in Dutch clinical texts: an evaluation of rule-based and machine learning methods

University Medical Center Utrecht(乌得勒支大学医学中心);Utrecht University(乌得勒支大学);MedxAI;University of Amsterdam(阿姆斯特丹大学);University of Vienna(维也纳大学)

Bram van Es, Leon C. Reteig, Sander C. Tan, Marijn Schraagen, Myrthe M. Hemker, Sebastiaan R. S. Arends, Miguel A. R. Rios, Saskia Haitjema

摘要:

由于结构化数据往往是不够的,标签需要从电子健康记录中的自由文本提取时,临床信息检索和决策支持系统开发模型。否定是临床文本中最重要的上下文属性之一,它表示没有发现。我们的目的是通过比较荷兰临床笔记中的三种否定检测方法来改善大规模标签提取。我们使用伊拉斯谟医学中心荷兰临床语料库来比较基于ContextD的基于规则的方法,使用MedCAT的biLSTM模型和基于RoberTa的模型。我们发现,biLSTM和RoBERTa模型在F1分数、精确度和召回率方面始终优于基于规则的模型。此外,我们系统地对每个模型的分类错误进行了分类,这可以用于进一步提高特定应用中的模型性能。单纯地将三种模型结合在一起,在性能上是没有好处的。我们的结论是,biLSTM和基于RoberTa的模型在检测临床否定方面非常准确,但最终所有三种方法都是可行的,这取决于手头的用例。

英文摘要:

As structured data are often insufficient, labels need to be extracted from free text in electronic health records when developing models for clinical information retrieval and decision support systems. One of the most important contextual properties in clinical text is negation, which indicates the absence of findings. We aimed to improve large scale extraction of labels by comparing three methods for negation detection in Dutch clinical notes. We used the Erasmus Medical Center Dutch Clinical Corpus to compare a rule-based method based on ContextD, a biLSTM model using MedCAT and (finetuned) RoBERTa-based models. We found that both the biLSTM and RoBERTa models consistently outperform the rule-based model in terms of F1 score, precision and recall. In addition, we systematically categorized the classification errors for each model, which can be used to further improve model performance in particular applications. Combining the three models naively was not beneficial in terms of performance. We conclude that the biLSTM and RoBERTa-based models in particular are highly accurate accurate in detecting clinical negations, but that ultimately all three approaches can be viable depending on the use case at hand.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑