Learnable Structural Semantic Readout for Graph Classification
University of Illinois at Urbana-Champaign (UIUC)(伊利诺伊大学厄巴纳-香槟分校 (UIUC));Pohang University of Science and Technology (POSTECH)(浦项科技大学 (POSTECH));Korea Advanced Institute of Science and Technology (KAIST)(韩国科学技术院 (KAIST))
Dongha Lee, Su Kim, Seonghyeon Lee, Chanyoung Park, Hwanjo Yu
With the great success of deep learning in various domains, graph neural networks (GNNs) also become a dominant approach to graph classification. By the help of a global readout operation that simply aggregates all node (or node-cluster) representations, existing GNN classifiers obtain a graph-level representation of an input graph and predict its class label using the representation. However, such global aggregation does not consider the structural information of each node, which results in information loss on the global structure. Particularly, it limits the discrimination power by enforcing the same weight parameters of the classifier for all the node representations; in practice, each of them contributes to target classes differently depending on its structural semantic. In this work, we propose structural semantic readout (SSRead) to summarize the node representations at the position-level, which allows to model the position-specific weight parameters for classification as well as to effectively capture the graph semantic relevant to the global structure. Given an input graph, SSRead aims to identify structurally-meaningful positions by using the semantic alignment between its nodes and structural prototypes, which encode the prototypical features of each position. The structural prototypes are optimized to minimize the alignment cost for all training graphs, while the other GNN parameters are trained to predict the class labels. Our experimental results demonstrate that SSRead significantly improves the classification performance and interpretability of GNN classifiers while being compatible with a variety of aggregation functions, GNN architectures, and learning frameworks.
Mitigating Degree Bias in Graph Representation Learning with Learnable Structural Augmentation and Structural Self-Attention
Department of Artificial Intelligence, The Catholic University of Korea(人工智能系,韩国天主大学);Data Assimilation Group, Korea Institute of Atmospheric Prediction Systems (KIAPS)(数据同化组,韩国大气预测研究所)
Graph Neural Networks with Learnable Structural and Positional Representations
Nanyang Technological University(南洋理工大学);Loyola Marymount University(洛约拉马利蒙特大学);Mila(米拉);University of Montréal(蒙特利尔大学);CIFAR(加拿大高级研究所);National University of Singapore(新加坡国立大学)
Structure Matters: Brain Graph Augmentation via Learnable Edge Masking for Data-efficient Psychiatric Diagnosis
Institute of Innovation, Science and Sustainability(创新、科学与可持续发展研究所);Federation University Australia(联邦大学澳大利亚分校);School of Information and Electronic Engineering(信息与电子工程学院);Zhejiang Gongshang University(浙江工商大学);School of Computing Technologies(计算技术学院);RMIT University(皇家墨尔本理工学院);School of Computing and Information Systems(计算与信息系统学院);The University of Melbourne(墨尔本大学)
Multi-Scale Harmonic Encoding for Feature-Wise Graph Message Passing
School of Mathematics and the Data Science Institute, Shandong University(数学学院和数据科学研究院,山东大学);School of Mathematics, Shandong University(数学学院,山东大学);Data Science Institute, Shandong University(数据科学研究院,山东大学)
Forget Less, Generalize More: Unifying Temporal and Structural Adaptation for Dynamic Graphs
University of Auckland, Auckland, New Zealand(奥克兰大学);University of Technology Sydney, Sydney, Australia(悉尼大学);Central China Normal University, Wuhan, China(Central China Normal University)
LEAP: Local ECT-Based Learnable Positional Encodings for Graphs
AIDOS Lab, University of Fribourg(弗里堡大学AIDOS实验室);Institute of AI for Health, Helmholtz Munich(慕尼黑亥姆霍兹人工智能与健康研究所);Technical University of Munich(慕尼黑技术大学);Department of Computer Science, ETH Zurich(苏黎世联邦理工学院计算机科学系);Department of Computer Science, University of Basel(巴塞尔大学计算机科学系)
Rethinking Dimensional Rationale in Graph Contrastive Learning from Causal Perspective
Science & Technology on Integrated Information System Laboratory, Institute of Software Chinese Academy of Sciences(中国科学院软件研究所综合信息系统技术国家级重点实验室);State Key Laboratory of Intelligent Game(智能博弈国家重点实验室);University of Chinese Academy of Sciences(中国科学院大学);State Key Laboratory of Computer Science, Institute of Software Chinese Academy of Sciences(中国科学院软件研究所计算机科学国家重点实验室)
Diffusion-Guided Pretraining for Brain Graph Foundation Models
Department of Electrical and Computer Engineering, Lehigh University, Bethlehem, PA, USA(电气与计算机工程系,莱维大学);Department of Computer Science and Engineering, Lehigh University, Bethlehem, PA, USA(计算机科学与工程系,莱维大学);Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, Stanford, CA, USA(精神病学与行为科学系,斯坦福大学医学院)
PLACE: Prompt Learning for Attributed Community Search in Large Graphs
Shenzhen Institute of Computing Sciences(深圳计算科学研究院);Beijing Institute of Technology(北京理工大学);Chinese University of Hong Kong(香港中文大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州))
Graph Neural Network and Transformer Integration for Unsupervised System Anomaly Discovery
Georgia Institute of Technology(佐治亚理工学院);University of Pennsylvania(宾夕法尼亚大学);Rose-Hulman Institute of Technology(罗斯-霍曼理工学院);University of California, Berkeley(加利福尼亚大学伯克利分校)
Physics-Guided Dual-Stream Heterogeneous Graph Neural Network for Predicting Full-Field Structural Response of Stiffened Panels
Department of Mechanical Engineering, The University of British Columbia(不列颠哥伦比亚大学机械工程系);Department of Civil Engineering, The University of British Columbia(不列颠哥伦比亚大学土木工程系)
Learnable Tree Filter for Structure-preserving Feature Transform
Megvii Research(旷视研究院);Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong Univeristy(西安交通大学人工智能与机器人研究所);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学);Megvii Inc. (Face++)(旷视科技(Face++))
MSDS: Deep Structural Similarity with Multiscale Representation
Fujian Key Lab for Intelligent Processing and Wireless Communication of Media Information, College of Physics and Information Engineering, Fuzhou University(福建省智能信息处理与无线通信重点实验室,物理与信息工程学院,福州大学);School of Computing and Information Science, Fuzhou Institute of Technology(计算机与信息科学学院,福州理工学院)
Robust Graph Contrastive Learning with Information Restoration
Department of Computer Science, Hong Kong Chu Hai College(香港 Chu Hai 学院计算机科学系);Department of Computing, The Hong Kong Polytechnic University(香港理工大学计算系);Department of Computer Science and Engineering, Washington University in St. Louis(华盛顿大学圣路易斯分校计算机科学与工程系)