arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2311.00296cs.CL
收藏

基于自适应特征和图神经网络的科学文献语义表示学习

Semantic Representation Learning of Scientific Literature based on Adaptive Feature and Graph Neural Network

Beijing Key Laboratory of Intelligent Communication Software and Multimedia(北京智能通信软件与多媒体重点实验室);School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications(计算机学院(国家级试点软件工程学院), 北京邮电大学);School of Economics and Management, Beijing University of Posts and Telecommunications(经济管理学院, 北京邮电大学)

Hongrui Gao, Yawen Li, Meiyu Liang, Zeli Guan, Zhe Xue

AI总结:

针对多数科学文献数据无标签的情况,提出基于自适应特征和图神经网络的语义表示学习方法,通过自适应特征处理、图注意力机制及无监督学习方法捕获局部和全局信息,在科学文献分类中表现出竞争力。

摘要:

由于大多数科学文献数据无标签,基于无监督图的语义表示学习至关重要。本文提出一种基于自适应特征和图神经网络的语义表示学习方法。通过引入自适应特征处理,全局和局部考虑科学文献特征。图注意力机制对由引用关系连接的科学文献特征加权并聚合,更有效地表达不同文献间相关性。还提出无监督图神经网络语义表示学习方法,通过比较科学文献正负局部语义表示与全局图语义表示在潜在空间的互信息,捕获局部和全局信息,改进语义表示学习。实验结果表明该方法在科学文献分类中具有竞争力。

英文摘要:

Because most scientific literature data are unlabeled, semantic representation learning based on unsupervised graphs has become crucial. To enrich scientific-literature features, this paper proposes a semantic representation learning method based on adaptive features and graph neural networks. By introducing adaptive feature processing, scientific-literature features are considered globally and locally. The graph attention mechanism weights and aggregates features of scientific documents connected by citation relations, so that correlations among different documents can be expressed more effectively. In addition, an unsupervised graph neural network semantic representation learning method is proposed. By comparing the mutual information between positive and negative local semantic representations of scientific literature and the global graph semantic representation in the latent space, the graph neural network captures local and global information and improves semantic representation learning. Experimental results show that the proposed method is competitive for scientific literature classification.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑