As structured data are often insufficient, labels need to be extracted from free text in electronic health records when developing models for clinical information retrieval and decision support systems. One of the most important contextual properties in clinical text is negation, which indicates the absence of findings. We aimed to improve large scale extraction of labels by comparing three methods for negation detection in Dutch clinical notes. We used the Erasmus Medical Center Dutch Clinical Corpus to compare a rule-based method based on ContextD, a biLSTM model using MedCAT and (finetuned) RoBERTa-based models. We found that both the biLSTM and RoBERTa models consistently outperform the rule-based model in terms of F1 score, precision and recall. In addition, we systematically categorized the classification errors for each model, which can be used to further improve model performance in particular applications. Combining the three models naively was not beneficial in terms of performance. We conclude that the biLSTM and RoBERTa-based models in particular are highly accurate accurate in detecting clinical negations, but that ultimately all three approaches can be viable depending on the use case at hand.
NegBio: a high-performance tool for negation and uncertainty detection in radiology reports
National Center for Biotechnology Information, National Library of Medicine, National Institutes of Health(美国国立卫生研究院国家医学图书馆国家生物技术信息中心);Department of Radiology and Imaging Sciences, Clinical Center, National Institutes of Health(美国国立卫生研究院临床中心放射与影像科学系)
Machine Learning for Violence Risk Assessment Using Dutch Clinical Notes
Utrecht University(乌得勒支大学);Eindhoven University of Technology(埃因霍温理工大学);University Medical Center Utrecht(乌得勒支大学医学中心);Leiden University Medical Center(莱顿大学医学中心);Leiden Institute of Advanced Computer Science(莱顿高级计算机科学研究所)
NUBES: A Corpus of Negation and Uncertainty in Spanish Clinical Texts
Vicomtech Foundation(维孔特克基金会);Basque Research and Technology Alliance (BRTA)(巴斯克研究与技术联盟(BRTA));HiTZ centre(HiTZ中心);University of the Basque Country UPV/EHU(巴斯克大学(UPV/EHU))
LongHealth: A Question Answering Benchmark with Long Clinical Documents
Technical University of Munich(慕尼黑工业大学);Charité – Universitätsmedizin Berlin(柏林夏里特医学院);University Hospital Aachen(亚琛大学医院);Kaduceo;Berliner Hochschule für Technik (BHT)(柏林工业大学);Mass General Brigham, Harvard Medical School(麻省总医院布莱根医疗集团,哈佛医学院);Maastricht University(马斯特里赫特大学);University Hospital RWTH Aachen(亚琛工业大学医院);Technical University Dresden(德累斯顿工业大学);German Heart Center Munich(慕尼黑德国心脏中心)
Out of the Box, into the Clinic? Evaluating State-of-the-Art ASR for Clinical Applications for Older Adults
Department of Public Health and Primary Care, Leiden University Medical Center(莱顿大学医学中心公共卫生与初级保健系);Leiden Institute of Advanced Computer Science, Leiden University(莱顿大学高级计算机科学研究所);Center for Medicine for Older People, Leiden University Medical Center(莱顿大学医学中心老年医学中心);Department of Internal Medicine, Leiden University Medical Center(莱顿大学医学中心内科系)
PAINT: A Framework for Multilingual Pain Representation from Medical Licensing Exams to Real-World Clinical Texts
University of Geneva(日内瓦大学);Massachusetts Institute of Technology(麻省理工学院);McGill University(麦吉尔大学);Harvard Medical School(哈佛医学院);Brigham and Women’s Hospital(布莱根妇女医院);Harvard T.H. Chan School of Public Health(哈佛陈曾熙公共卫生学院);Mahidol University(玛希隆大学);Seoul National University Hospital(首尔大学医院);National Taiwan University(国立台湾大学);Universidade de São Paulo(圣保罗大学);Santa Marcelina College of Medicine(圣马塞利纳医学院);Universidad Peruana Cayetano Heredia(秘鲁卡耶塔诺埃雷迪亚大学);HM Hospitales(HM医院集团);St. Luke’s Medical Center College of Medicine(圣路加医疗中心医学院);Fukushima Medical University(福岛医科大学);Beth Israel Deaconess Medical Center(贝斯以色列女执事医疗中心)
PromptRad: Knowledge-Enhanced Multi-Label Prompt-Tuning for Low-Resource Radiology Report Labeling
Department of Artificial Intelligence and AI Research Center, Chang Gung University(人工智能系及AI研究中心,长庚大学);Department of Radiology, Sijhih Cathay General Hospital(放射科,西吉医院);Department of Medical Imaging and Intervention, Chang Gung Memorial Hospital(医学影像与介入科,长庚纪念医院);Department of Trauma and Emergency Surgery, Chang Gung Memorial Hospital(创伤与急诊外科,长庚纪念医院);Department of Computer Science, National Tsing Hua University(计算机科学系,国立清华大学)