arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2010.14587cs.CL
收藏

论临床报告标签的收益递减

On the diminishing return of labeling clinical reports

Enlitic(Enlitic公司)

Jean-Baptiste Lamare, Tobi Olatunji, Li Yao

摘要:

大量证据表明,通过在非医学领域的自然语言处理(NLP)问题上对越来越大的数据集进行训练,可以稳定地获得更好的机器学习模型。到目前为止,医学NLP是否也是如此还没有得到彻底的调查。这项工作表明,情况并非总是如此。我们揭示了某种反直觉的观察,即可以用少量的标记数据获得高性能的医学NLP模型,这与常见的信念完全相反,很可能是由于问题的领域特异性。我们定量显示了训练数据大小对由两个最大的公共胸部X射线放射学报告数据集组成的固定测试集异常分类任务的影响。经过训练的模型不仅有效地利用了训练数据,而且在性能上大大优于当前最先进的基于规则的系统。

英文摘要:

Ample evidence suggests that better machine learning models may be steadily obtained by training on increasingly larger datasets on natural language processing (NLP) problems from non-medical domains. Whether the same holds true for medical NLP has by far not been thoroughly investigated. This work shows that this is indeed not always the case. We reveal the somehow counter-intuitive observation that performant medical NLP models may be obtained with small amount of labeled data, quite the opposite to the common belief, most likely due to the domain specificity of the problem. We show quantitatively the effect of training data size on a fixed test set composed of two of the largest public chest x-ray radiology report datasets on the task of abnormality classification. The trained models not only make use of the training data efficiently, but also outperform the current state-of-the-art rule-based systems by a significant margin.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑