arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2002.04813cs.LGstat.ML
收藏

基于分层图神经网络的深度多任务增强特征学习

Deep Multi-Task Augmented Feature Learning via Hierarchical Graph Neural Network

Southern University of Science and Technology(南方科技大学);Department of Computer Science and Engineering, Southern University of Science and Technology, China(中国南方科技大学计算机科学与工程系)

Pengxin Guo, Chang Deng, Linjie Xu, Xiaonan Huang, Yu Zhang

摘要:

近年来,深度多任务学习因其在许多应用中取得了良好的性能而备受关注。特征学习对于深度多任务学习非常重要,可以在任务之间共享公共信息。在本文中,我们提出了一种分层图神经网络(HGNN)来学习深度多任务学习的增强特征。HGNN由两级图神经网络组成。在低层,任务内图神经网络负责通过聚合其邻居来学习任务中每个数据点的强大表示。基于学习的表示,可以以与最大池化类似的方式为每个任务生成任务嵌入。在第二层中,任务间图神经网络基于注意力机制更新所有任务的任务嵌入,以建模任务关系。然后利用一个任务的任务嵌入来增强该任务中数据点的特征表示。此外,对于分类任务,引入了类间图神经网络,以在更细的粒度上进行类似的操作,即,类级别,为所有任务中的每个类生成类嵌入,使用类嵌入来增强特征表示。所提出的特征增强策略可以用于许多深度多任务学习模型。我们从训练和泛化损失的角度分析HGNN。在真实网络上的实验表明,使用该策略可以显著提高性能。

英文摘要:

Deep multi-task learning attracts much attention in recent years as it achieves good performance in many applications. Feature learning is important to deep multi-task learning for sharing common information among tasks. In this paper, we propose a Hierarchical Graph Neural Network (HGNN) to learn augmented features for deep multi-task learning. The HGNN consists of two-level graph neural networks. In the low level, an intra-task graph neural network is responsible of learning a powerful representation for each data point in a task by aggregating its neighbors. Based on the learned representation, a task embedding can be generated for each task in a similar way to max pooling. In the second level, an inter-task graph neural network updates task embeddings of all the tasks based on the attention mechanism to model task relations. Then the task embedding of one task is used to augment the feature representation of data points in this task. Moreover, for classification tasks, an inter-class graph neural network is introduced to conduct similar operations on a finer granularity, i.e., the class level, to generate class embeddings for each class in all the tasks use class embeddings to augment the feature representation. The proposed feature augmentation strategy can be used in many deep multi-task learning models. we analyze the HGNN in terms of training and generalization losses. Experiments on real-world datastes show the significant performance improvement when using this strategy.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑