arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2208.06956cs.LG

ARIEL:对抗性图对比学习

ARIEL: Adversarial Graph Contrastive Learning

Carnegie Mellon University(卡内基梅隆大学);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);IBM Research(IBM研究院)

Shengyu Feng, Baoyu Jing, Yada Zhu, Hanghang Tong

AI总结:

本文提出对抗性图对比学习(ARIEL),通过对抗性图视图增强数据,结合信息正则化与子图采样,在节点和图级分类任务上优于现有方法,并更具鲁棒性。

摘要:

对比学习是图表示学习中的一种有效的无监督方法,对比学习的关键组成部分在于正样本和负样本的构建。以往的方法通常利用图中节点的邻近性作为原则。最近,基于数据增强的对比学习方法在视觉领域展现出强大的能力,一些工作将此方法从图像扩展到图。然而,与图像上的数据增强不同,图上的数据增强远不那么直观,且更难提供高质量的对比样本,这留下了很大的改进空间。在这项工作中,通过引入对抗性图视图进行数据增强,我们提出了一种简单但有效的方法,即对抗性图对比学习(ARIEL),以在合理约束内提取信息丰富的对比样本。我们开发了一种称为信息正则化的新技术用于稳定训练,并使用子图采样以实现可扩展性。我们通过将每个图实例视为超级节点,将我们的方法从节点级对比学习推广到图级。ARIEL在真实世界数据集上的节点级和图级分类任务中始终优于当前的图对比学习方法。我们进一步证明,ARIEL在面对对抗性攻击时更加鲁棒。

英文摘要:

Contrastive learning is an effective unsupervised method in graph representation learning, and the key component of contrastive learning lies in the construction of positive and negative samples. Previous methods usually utilize the proximity of nodes in the graph as the principle. Recently, the data-augmentation-based contrastive learning method has advanced to show great power in the visual domain, and some works extended this method from images to graphs. However, unlike the data augmentation on images, the data augmentation on graphs is far less intuitive and much harder to provide high-quality contrastive samples, which leaves much space for improvement. In this work, by introducing an adversarial graph view for data augmentation, we propose a simple but effective method, Adversarial Graph Contrastive Learning (ARIEL), to extract informative contrastive samples within reasonable constraints. We develop a new technique called information regularization for stable training and use subgraph sampling for scalability. We generalize our method from node-level contrastive learning to the graph level by treating each graph instance as a super-node. ARIEL consistently outperforms the current graph contrastive learning methods for both node-level and graph-level classification tasks on real-world datasets. We further demonstrate that ARIEL is more robust in the face of adversarial attacks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑