arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2305.00366cs.CLcs.IRcs.LG
收藏

S2abEL:一个面向科学表格实体链接的数据集

S2abEL: A Dataset for Entity Linking from Scientific Tables

University of Michigan(密歇根大学);Allen Institute for AI(艾伦人工智能研究所)

Yuze Lou, Bailey Kuehl, Erin Bransom, Sergey Feldman, Aakanksha Naik, Doug Downey

AI总结:

该研究推出首个面向科学表格的实体链接数据集S2abEL,含732张表格的8429个单元格的人工标注,提出适配知识库外提及的神经基线方法,性能优于通用SOTA方法,同时指出仍有提升空间。

摘要:

实体链接(EL)是将文本提及映射到知识库中对应条目的任务,对众多知识密集型自然语言处理应用至关重要。将实体链接应用于科学论文中的表格,是构建大规模科学知识库的关键一步,可支撑高级科学问答与分析任务。我们推出了首个面向科学表格实体链接的数据集。科学表格实体链接的挑战尤为突出:科学知识库往往存在大量缺失,且消歧表格中的提及通常需要结合表格内容与论文正文进行理解。我们的数据集S2abEL聚焦机器学习结果表格的实体链接任务,包含来自732张表格的8429个单元格的人工标注信息,涵盖单元格类型、归因来源,以及匹配PaperswithCode分类体系的实体链接。我们提出了一种针对含大量知识库外提及的科学表格实体链接的神经基线方法,实验表明其性能显著优于当前最优的通用表格实体链接方法。表现最佳的基线方法性能仍低于人类水平,我们的分析也指出了未来的改进方向。

英文摘要:

Entity linking (EL) is the task of linking a textual mention to its corresponding entry in a knowledge base, and is critical for many knowledge-intensive NLP applications. When applied to tables in scientific papers, EL is a step toward large-scale scientific knowledge bases that could enable advanced scientific question answering and analytics. We present the first dataset for EL in scientific tables. EL for scientific tables is especially challenging because scientific knowledge bases can be very incomplete, and disambiguating table mentions typically requires understanding the papers's tet in addition to the table. Our dataset, S2abEL, focuses on EL in machine learning results tables and includes hand-labeled cell types, attributed sources, and entity links from the PaperswithCode taxonomy for 8,429 cells from 732 tables. We introduce a neural baseline method designed for EL on scientific tables containing many out-of-knowledge-base mentions, and show that it significantly outperforms a state-of-the-art generic table EL method. The best baselines fall below human performance, and our analysis highlights avenues for improvement.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑