arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2201.03326cs.LG
收藏

多任务环境下的图表示学习:一种元学习方法

Graph Representation Learning for Multi-Task Settings: a Meta-Learning Approach

University of Padova(帕多瓦大学)

Davide Buffelli, Fabio Vandin

摘要:

图神经网络(GNNs)已经成为许多图结构数据应用的最先进方法。GNN是用于图表示学习的模型,其目的是学习生成封装结构和特征相关信息的低维节点嵌入。GNN通常以端到端的方式进行训练,导致高度专业化的节点嵌入。虽然这种方法在单任务设置中取得了很好的效果,但生成可用于执行多个任务的节点嵌入(性能与单任务模型相当)仍然是一个悬而未决的问题。我们建议使用元学习来训练能够产生多任务节点嵌入的GNN模型。特别是,我们利用基于优化的元学习的特性来学习GNN,这些GNN可以通过学习参数来生成通用节点表示,这些参数可以快速(即通过几步梯度下降)适应多个任务。我们的实验表明,使用我们特意设计的元学习过程训练的模型产生的嵌入可以用于执行多个任务,其性能与单任务和多任务端到端模型相当,甚至更高。

英文摘要:

Graph Neural Networks (GNNs) have become the state-of-the-art method for many applications on graph structured data. GNNs are a model for graph representation learning, which aims at learning to generate low dimensional node embeddings that encapsulate structural and feature-related information. GNNs are usually trained in an end-to-end fashion, leading to highly specialized node embeddings. While this approach achieves great results in the single-task setting, the generation of node embeddings that can be used to perform multiple tasks (with performance comparable to single-task models) is still an open problem. We propose the use of meta-learning to allow the training of a GNN model capable of producing multi-task node embeddings. In particular, we exploit the properties of optimization-based meta-learning to learn GNNs that can produce general node representations by learning parameters that can quickly (i.e. with a few steps of gradient descent) adapt to multiple tasks. Our experiments show that the embeddings produced by a model trained with our purposely designed meta-learning procedure can be used to perform multiple tasks with comparable or, surprisingly, even higher performance than both single-task and multi-task end-to-end models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑