arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2302.03341cs.DLcs.CLcs.LG
收藏

元数据对科学文献标注的影响:一项跨领域跨模型研究

The Effect of Metadata on Scientific Literature Tagging: A Cross-Field Cross-Model Study

University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)

Yu Zhang, Bowen Jin, Qi Zhu, Yu Meng, Jiawei Han

AI总结:

本研究跨19个领域和3种多标签分类器系统评估了元数据对科学文献标注的影响,发现会议/期刊等元数据普遍提升标注性能,并揭示了计算机科学与生物医学以外领域的独特影响模式。

摘要:

由于网络上科学出版物的指数级增长,迫切需要为每篇论文标注细粒度主题,以便研究人员能够追踪其感兴趣的领域,而不是淹没在整个文献中。科学文献标注不仅仅是一个纯多标签文本分类任务,因为网络上的论文通常伴随着诸如会议/期刊、作者和参考文献等元数据信息,这些信息可以作为推断相关标签的额外信号。尽管已有研究在学术论文分类中利用了元数据,但其关注点通常局限于一个或两个科学领域(如计算机科学和生物医学)以及一个特定模型。在本研究中,我们系统地研究了元数据对19个领域科学文献标注的影响。我们选择了三个具有代表性的多标签分类器(即词袋模型、基于序列的模型和预训练语言模型),并探讨了当元数据作为额外特征输入分类器时,它们在科学文献标注中的性能变化。我们观察到元数据影响在所有领域的一些普遍模式(例如,会议/期刊在几乎所有情况下对论文标注都有益),以及计算机科学和生物医学以外的领域中的一些独特模式,这些在以前的研究中未被探索过。

英文摘要:

Due to the exponential growth of scientific publications on the Web, there is a pressing need to tag each paper with fine-grained topics so that researchers can track their interested fields of study rather than drowning in the whole literature. Scientific literature tagging is beyond a pure multi-label text classification task because papers on the Web are prevalently accompanied by metadata information such as venues, authors, and references, which may serve as additional signals to infer relevant tags. Although there have been studies making use of metadata in academic paper classification, their focus is often restricted to one or two scientific fields (e.g., computer science and biomedicine) and to one specific model. In this work, we systematically study the effect of metadata on scientific literature tagging across 19 fields. We select three representative multi-label classifiers (i.e., a bag-of-words model, a sequence-based model, and a pre-trained language model) and explore their performance change in scientific literature tagging when metadata are fed to the classifiers as additional features. We observe some ubiquitous patterns of metadata's effects across all fields (e.g., venues are consistently beneficial to paper tagging in almost all cases), as well as some unique patterns in fields other than computer science and biomedicine, which are not explored in previous studies.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑