arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2209.00446cs.IRcs.LG
收藏

图神经网络自监督预训练在科技论文相关数学表达式检索中的应用

Self-Supervised Pretraining of Graph Neural Network for the Retrieval of Related Mathematical Expressions in Scientific Articles

TU Dortmund University(多特蒙德工业大学)

Lukas Pfahler, Katharina Morik

摘要:

由于出版物的增加,搜索相关论文变得繁琐。特别是,不支持跨学科或跨思想流派的搜索。这主要是由于关键字查询的检索:技术术语在不同的科学或不同的时间是不同的。相关文章最好通过其数学问题描述来识别。仅仅看一下论文中的方程就已经暗示了这篇论文是否相关。因此,我们提出了一种基于机器学习的数学表达式检索新方法。我们设计了一个无监督的表示学习任务,结合嵌入学习和自监督学习。使用图卷积神经网络,我们嵌入数学表达式到低维向量空间,允许有效的最近邻查询。为了训练我们的模型,我们从arXiv.org上发布的90多万种出版物中收集了一个巨大的数据集,其中包含超过2900万个数学表达式。我们的经验评估涉及一个新的数据集手动注释的搜索查询显示使用嵌入模型的数学检索的好处。这项工作最初发表在KDD 2020上。

英文摘要:

Given the increase of publications, search for relevant papers becomes tedious. In particular, search across disciplines or schools of thinking is not supported. This is mainly due to the retrieval with keyword queries: technical terms differ in different sciences or at different times. Relevant articles might better be identified by their mathematical problem descriptions. Just looking at the equations in a paper already gives a hint to whether the paper is relevant. Hence, we propose a new approach for retrieval of mathematical expressions based on machine learning. We design an unsupervised representation learning task that combines embedding learning with self-supervised learning. Using graph convolutional neural networks we embed mathematical expression into low-dimensional vector spaces that allow efficient nearest neighbor queries. To train our models, we collect a huge dataset with over 29 million mathematical expressions from over 900,000 publications published on arXiv.org. The math is converted into an XML format, which we view as graph data. Our empirical evaluations involving a new dataset of manually annotated search queries show the benefits of using embedding models for mathematical retrieval. This work was originally published at KDD 2020.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑