arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1906.08470cs.DLcs.IR
收藏

清理嘈杂和异构的元数据,用于跨学术大数据集的记录链接

Cleaning Noisy and Heterogeneous Metadata for Record Linking Across Scholarly Big Datasets

Athar Sefid, Jian Wu, Allen C. Ge, Jing Zhao, Lu Liu, Cornelia Caragea, Prasenjit Mitra, C. Lee Giles

摘要:

从PDF格式的学术文档中自动提取的元数据通常是嘈杂和异构的,通常包含不完整的字段和错误的值。清理元数据的一种常见方法是使用书目参考数据集。挑战在于以高精度匹配语料库之间的记录。现有的解决方案是基于信息检索和字符串相似性的标题,只有当标题是干净的。我们介绍了一个系统,旨在匹配学术文档实体与噪声元数据对参考数据集。blocking函数使用经典的BM25算法从ElasticSearch索引的参考数据中找到匹配的候选项。核心组件使用监督方法,结合从所有可用的元数据字段中提取的特征。该系统还利用可用的引用信息来匹配实体。元数据和引用的组合实现了高准确性,在相同的测试数据集上显著优于基线方法。我们应用这个系统来匹配CiteSeerX对Web of Science,PubMed和DBLP的数据库。这种方法将部署在CiteSeerX系统中,以清理元数据并将记录链接到其他学术大数据集。

英文摘要:

Automatically extracted metadata from scholarly documents in PDF formats is usually noisy and heterogeneous, often containing incomplete fields and erroneous values. One common way of cleaning metadata is to use a bibliographic reference dataset. The challenge is to match records between corpora with high precision. The existing solution which is based on information retrieval and string similarity on titles works well only if the titles are cleaned. We introduce a system designed to match scholarly document entities with noisy metadata against a reference dataset. The blocking function uses the classic BM25 algorithm to find the matching candidates from the reference data that has been indexed by ElasticSearch. The core components use supervised methods which combine features extracted from all available metadata fields. The system also leverages available citation information to match entities. The combination of metadata and citation achieves high accuracy that significantly outperforms the baseline method on the same test dataset. We apply this system to match the database of CiteSeerX against Web of Science, PubMed, and DBLP. This method will be deployed in the CiteSeerX system to clean metadata and link records to other scholarly big datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑