从PDF格式的学术文档中自动提取的元数据通常是嘈杂和异构的,通常包含不完整的字段和错误的值。清理元数据的一种常见方法是使用书目参考数据集。挑战在于以高精度匹配语料库之间的记录。现有的解决方案是基于信息检索和字符串相似性的标题,只有当标题是干净的。我们介绍了一个系统,旨在匹配学术文档实体与噪声元数据对参考数据集。blocking函数使用经典的BM25算法从ElasticSearch索引的参考数据中找到匹配的候选项。核心组件使用监督方法,结合从所有可用的元数据字段中提取的特征。该系统还利用可用的引用信息来匹配实体。元数据和引用的组合实现了高准确性,在相同的测试数据集上显著优于基线方法。我们应用这个系统来匹配CiteSeerX对Web of Science,PubMed和DBLP的数据库。这种方法将部署在CiteSeerX系统中,以清理元数据并将记录链接到其他学术大数据集。
英文摘要:
Automatically extracted metadata from scholarly documents in PDF formats is usually noisy and heterogeneous, often containing incomplete fields and erroneous values. One common way of cleaning metadata is to use a bibliographic reference dataset. The challenge is to match records between corpora with high precision. The existing solution which is based on information retrieval and string similarity on titles works well only if the titles are cleaned. We introduce a system designed to match scholarly document entities with noisy metadata against a reference dataset. The blocking function uses the classic BM25 algorithm to find the matching candidates from the reference data that has been indexed by ElasticSearch. The core components use supervised methods which combine features extracted from all available metadata fields. The system also leverages available citation information to match entities. The combination of metadata and citation achieves high accuracy that significantly outperforms the baseline method on the same test dataset. We apply this system to match the database of CiteSeerX against Web of Science, PubMed, and DBLP. This method will be deployed in the CiteSeerX system to clean metadata and link records to other scholarly big datasets.
Enriching the scholarly metadata commons with citation metadata and spatio-temporal metadata to support responsible research assessment and research discovery
Comparison of Feature Learning Methods for Metadata Extraction from PDF Scholarly Documents
Fraunhofer Institute for Applied Information Technology FIT(弗劳恩霍夫应用信息技术研究所FIT);University Hospital of Cologne(科隆大学医院);University of Koblenz(科布伦茨大学);Soochow University(苏州大学)
A dataset of article processing charges from 14 scholarly publishers, 2019-2025
Berlin School of Library and Information Science, Humboldt-Universität zu Berlin(柏林图书馆与信息科学学院,柏林洪堡大学);Scholarly Communications Lab(学术交流实验室);University Library, Iowa State University(爱荷华州立大学图书馆);Simon Fraser University(西蒙菲莎大学);School of Information Studies, University of Ottawa(渥太华大学信息研究学院);University of Ottawa Library(渥太华大学图书馆);University Library, Bielefeld University(比勒费尔德大学图书馆)
The Science Data Lake: A Unified Open Infrastructure Integrating 293 Million Papers Across Eight Scholarly Sources with Embedding-Based Ontology Alignment