arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2204.04779cs.CLcs.LG
收藏

MedDistant19:面向广泛覆盖的生物医学关系抽取的精确基准

MedDistant19: Towards an Accurate Benchmark for Broad-Coverage Biomedical Relation Extraction

German Research Center for Artificial Intelligence(德国人工智能研究中心);Saarland University(萨尔大学);Yale Center for Medical Informatics(耶鲁医学信息学中心);UCL Centre for Artificial Intelligence(伦敦大学学院人工智能中心)

Saadullah Amin, Pasquale Minervini, David Chang, Pontus Stenetorp, Günter Neumann

摘要:

由于缺乏标记数据和高昂的注释成本,生物医学领域的关系抽取具有挑战性,需要领域专家。远程监督通常用于通过将知识图谱关系与原始文本自动配对来解决注释数据的稀缺性。这样的流水线容易产生噪声,并且为覆盖大量生物医学概念的规模增加了挑战。我们调查了现有的广泛覆盖的远程监督生物医学关系抽取基准,发现训练和测试关系之间的重叠范围从26%到86%。此外,我们注意到这些基准测试的数据构建过程中存在一些不一致之处,并且在没有训练测试泄漏的情况下,重点是更窄的实体类型之间的交互。这项工作提出了一个更准确的基准MedDistant19广泛覆盖的远程监督的生物医学关系抽取,解决了这些缺点,并通过调整MEDLINE摘要与广泛使用的SNOMED临床术语知识库。缺乏与特定领域的语言模型进行彻底的评估,我们还进行实验验证一般领域的关系抽取的结果,生物医学关系抽取。

英文摘要:

Relation extraction in the biomedical domain is challenging due to the lack of labeled data and high annotation costs, needing domain experts. Distant supervision is commonly used to tackle the scarcity of annotated data by automatically pairing knowledge graph relationships with raw texts. Such a pipeline is prone to noise and has added challenges to scale for covering a large number of biomedical concepts. We investigated existing broad-coverage distantly supervised biomedical relation extraction benchmarks and found a significant overlap between training and test relationships ranging from 26% to 86%. Furthermore, we noticed several inconsistencies in the data construction process of these benchmarks, and where there is no train-test leakage, the focus is on interactions between narrower entity types. This work presents a more accurate benchmark MedDistant19 for broad-coverage distantly supervised biomedical relation extraction that addresses these shortcomings and is obtained by aligning the MEDLINE abstracts with the widely used SNOMED Clinical Terms knowledge base. Lacking thorough evaluation with domain-specific language models, we also conduct experiments validating general domain relation extraction findings to biomedical relation extraction.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑