We present Adaptive Multi-layer Contrastive Graph Neural Networks (AMC-GNN), a self-supervised learning framework for Graph Neural Network, which learns feature representations of sample data without data labels. AMC-GNN generates two graph views by data augmentation and compares different layers' output embeddings of Graph Neural Network encoders to obtain feature representations, which could be used for downstream tasks. AMC-GNN could learn the importance weights of embeddings in different layers adaptively through the attention mechanism, and an auxiliary encoder is introduced to train graph contrastive encoders better. The accuracy is improved by maximizing the representation's consistency of positive pairs in the early layers and the final embedding space. Our experiments show that the results can be consistently improved by using the AMC-GNN framework, across four established graph benchmarks: Cora, Citeseer, Pubmed, DBLP citation network datasets, as well as four newly proposed datasets: Co-author-CS, Co-author-Physics, Amazon-Computers, Amazon-Photo.
CoCo: A Coupled Contrastive Framework for Unsupervised Domain Adaptive Graph Classification
Department of Machine Learning, Mohamed bin Zayed University of Artificial Intelligence, Abu Dhabi, UAE(机器学习系,Mohamed bin Zayed人工智能大学,阿布扎赫德,阿联酋);JD Explore Academy, Beijing, China(京东探索研究院,北京,中国);Department of Computer Science and Technology, National University of Defense Technology, Changsha, China(计算机科学与技术系,国防科技大学,长沙,中国);School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen, China(计算机科学与技术学院,哈尔滨工业大学,深圳,中国);Department of Computer Science, University of California, Los Angeles, USA(计算机科学系,加州大学洛杉矶分校,美国)
scAGC: Learning Adaptive Cell Graphs with Contrastive Guidance for Single-Cell Clustering
Shanghai Key Laboratory of Trustworthy Computing, East China Normal University, Shanghai, China(上海可信计算实验室,华东师范大学);Department of Computational Biology, Mohamed bin Zayed University of AI, Abu Dhabi, UAE(计算生物学系,马尔代夫人工智能大学);Department of Computer Science, Stevens Institute of Technology, Hoboken, USA(计算机科学系,史蒂文斯理工学院);College of Electronics and Information Engineering, Tongji University, Shanghai, China(电子信息工程学院,同济大学)
Hybrid-Collaborative Augmentation and Contrastive Sample Adaptive-Differential Awareness for Robust Attributed Graph Clustering
College of Information Science and Technology, Beijing University of Chemical Technology(北京化工大学信息科学与技术学院);Beijing University of Technology(北京工业大学);The University of Sydney Business School, The University of Sydney(悉尼大学商学院)
Graph Contrastive Learning with Adaptive Augmentation
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学);Beijing University of Posts and Telecommunications(北京邮电大学);Alibaba Group(阿里巴巴集团)
Adaptive Multi-view Graph Contrastive Learning via Fractional-order Neural Diffusion Networks
School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore(南洋理工大学电子与电气工程学院);University College London, London, U.K.(伦敦大学学院)
CHAM-net: A Contrastive Hierarchical Adaptive Meta-network for Robust Global Methane Flux Prediction
University of Pittsburgh(匹兹堡大学);Purdue University(普渡大学);University of Colorado Boulder(科罗拉多大学博尔德分校);NOAA Global Monitoring Laboratory(国家海洋大气管理局全球监测实验室);University of Wisconsin–Madison(威斯康星大学麦迪逊分校);University of Maryland(马里兰大学)
AdNGCL: Adaptive Negative Scheduling for Graph Contrastive Learning
Jinan University(暨南大学);University of Science and Technology of China(中国科学技术大学);Hainan University(海南大学);Manchester Metropolitan University(曼彻斯特城市大学);King Abdulaziz University(阿卜杜勒阿齐兹国王大学)
An Adaptive Contrastive Learning Model for Spike Sorting
Tsinghua Shenzhen International Graduate School(清华大学深圳国际研究生院);Tsinghua University(清华大学);Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);University of Chinese Academy of Sciences(中国科学院大学)
SLSREC: Self-Supervised Contrastive Learning for Adaptive Fusion of Long- and Short-Term User Interests
School of Artificial Intelligence, Shenzhen University(深圳大学人工智能学院);Shenzhen Technology University(深圳技术大学);College of Computer Science, Chongqing University(重庆大学计算机学院)
Visual Perturbation and Adaptive Hard Negative Contrastive Learning for Compositional Reasoning in Vision-Language Models
School of Artificial Intelligence and Software Engineering, Nanyang Normal University, Henan, China(人工智能与软件工程学院,南阳师范学院,河南);Institute for Artificial Intelligence, Peking University, Beijing, China(人工智能研究院,北京大学,北京);Collaborative Innovation Center of Intelligent Explosion-proof Equipment, Henan, China(智能防爆设备协同创新中心,河南)
FedTGP: Trainable Global Prototypes with Adaptive-Margin-Enhanced Contrastive Learning for Data and Model Heterogeneity in Federated Learning
Shanghai Jiao Tong University(上海交通大学);Institute for AI Industry Research, Tsinghua University(清华大学智能产业研究院);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Queen’s University Belfast(英国女王大学)