arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2005.04177cs.CL
收藏

证据推理2.0:更多的数据,更好的模型

Evidence Inference 2.0: More Data, Better Models

Northeastern University(东北大学)

Jay DeYoung, Eric Lehman, Ben Nye, Iain J. Marshall, Byron C. Wallace

摘要:

我们如何最有效地治疗疾病或病症?理想情况下,我们可以查阅从临床试验中收集的证据数据库来回答这些问题。不幸的是,没有这样的数据库;临床试验结果主要通过冗长的自然语言文章传播。阅读所有这些文章将是令人望而却步的医疗从业者耗时;他们反而倾向于依赖于手动编译的医学文献的系统评价,以告知护理。NLP可能会加速这个过程,并最终促进对已发表证据的即时查阅。证据推理数据集最近发布,以促进为此目的的研究。这项任务需要从一篇特定的文章(描述临床试验)中推断出两种治疗方法在给定结果方面的比较性能,并确定支持证据。例如:这篇文章是否报道了化疗比手术更能提高可手术癌症的五年生存率?在本文中,我们收集了额外的注释,将证据推理数据集扩展了25%,提供了更强大的基线模型,系统地检查了这些错误,并探测了数据集的质量。我们还发布了一个用于快速模型原型的任务的仅摘要(而不是全文)版本。更新后的语料库、文档和新基线和评估代码可在http://evidence-inference.ebm-nlp.com/上获得。

英文摘要:

How do we most effectively treat a disease or condition? Ideally, we could consult a database of evidence gleaned from clinical trials to answer such questions. Unfortunately, no such database exists; clinical trial results are instead disseminated primarily via lengthy natural language articles. Perusing all such articles would be prohibitively time-consuming for healthcare practitioners; they instead tend to depend on manually compiled systematic reviews of medical literature to inform care. NLP may speed this process up, and eventually facilitate immediate consult of published evidence. The Evidence Inference dataset was recently released to facilitate research toward this end. This task entails inferring the comparative performance of two treatments, with respect to a given outcome, from a particular article (describing a clinical trial) and identifying supporting evidence. For instance: Does this article report that chemotherapy performed better than surgery for five-year survival rates of operable cancers? In this paper, we collect additional annotations to expand the Evidence Inference dataset by 25\%, provide stronger baseline models, systematically inspect the errors that these make, and probe dataset quality. We also release an abstract only (as opposed to full-texts) version of the task for rapid model prototyping. The updated corpus, documentation, and code for new baselines and evaluations are available at http://evidence-inference.ebm-nlp.com/.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑