Feature Correlation Aggregation: on the Path to Better Graph Neural Networks
Australian National University(澳大利亚国立大学);École polytechnique fédérale de Lausanne(洛桑联邦理工学院);Data61, CSIRO(澳大利亚联邦科学与工业研究组织数据61);Monash University(莫纳什大学)
Jieming Zhou, Tong Zhang, Pengfei Fang, Lars Petersson, Mehrtash Harandi
Prior to the introduction of Graph Neural Networks (GNNs), modeling and analyzing irregular data, particularly graphs, was thought to be the Achilles' heel of deep learning. The core concept of GNNs is to find a representation by recursively aggregating the representations of a central node and those of its neighbors. The core concept of GNNs is to find a representation by recursively aggregating the representations of a central node and those of its neighbor, and its success has been demonstrated by many GNNs' designs. However, most of them only focus on using the first-order information between a node and its neighbors. In this paper, we introduce a central node permutation variant function through a frustratingly simple and innocent-looking modification to the core operation of a GNN, namely the Feature cOrrelation aGgregation (FOG) module which learns the second-order information from feature correlation between a node and its neighbors in the pipeline. By adding FOG into existing variants of GNNs, we empirically verify this second-order information complements the features generated by original GNNs across a broad set of benchmarks. A tangible boost in performance of the model is observed where the model surpasses previous state-of-the-art results by a significant margin while employing fewer parameters. (e.g., 33.116% improvement on a real-world molecular dataset using graph convolutional networks).
HAGNN: Hybrid Aggregation for Heterogeneous Graph Neural Networks
State Key Laboratory for Novel Software Technology, Nanjing University(南京大学现代软件技术国家重点实验室);Research Center for Graph Computing, Zhejiang Lab(浙江实验室图计算研究中心)
Beyond the Aggregation Dilemma: Prior-Retaining Decoupled Learning for Multimodal Graphs
School of Computer Science and Engineering, Central South University(中南大学计算机科学与工程学院);Department of Data Science and Artificial Intelligence, The Hong Kong Polytechnic University(香港理工大学数据科学与人工智能系);School of Information and Communication Technology, Griffith University(格里菲斯大学信息与通信技术学院)
Sloan Kettering Institute(斯隆凯特琳研究所);Memorial Sloan Kettering Cancer Center(纪念斯隆凯特琳癌症中心);City College of New York(纽约城市学院);City University of New York(纽约城市大学);Facebook, Inc.(脸书公司)
Differentiable Feature Aggregation Search for Knowledge Distillation
Peking University(北京大学);Megvii (Face++) Technology Inc(旷视科技(Face++));National Engineering Laboratory for Big Data Analysis and Applications(大数据分析与应用技术国家工程实验室);DiDi AI Labs(滴滴人工智能实验室)
Provably Better Explanations with Optimized Aggregation of Feature Attributions
LMU Munich(慕尼黑大学);Siemens AG(西门子公司);Technical University of Munich(慕尼黑工业大学);University of Oxford(牛津大学);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心);German Cancer Research Center (DKFZ)(德国癌症研究中心);Goethe University Frankfurt(法兰克福大学)
Better than Average: Spatially-Aware Aggregation of Segmentation Uncertainty Improves Downstream Performance
Max-Delbrück-Center (MDC)(马克斯·德尔布吕克中心);Helmholtz Imaging(亥姆霍兹成像);Charité Universitätsmedizin(柏林夏里特医学院);Humboldt-Universität zu Berlin(柏林洪堡大学);University of Potsdam(波茨坦大学);German Cancer Research Center (DKFZ)(德国癌症研究中心);Heidelberg University(海德堡大学)
Pause and Reflect: Conformal Aggregation for Chain-of-Thought Reasoning
Department of Mathematics and Statistics(数学与统计学系);McGill University(麦吉尔大学);Department of Mathematics and Industrial Engineering(数学与工业工程系);Polytechnique de Montréal(蒙特利尔理工学院)
From Social to Individuals: a Parsimonious Path of Multi-level Models for Crowdsourced Preference Aggregation
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);Tencent AI Lab(腾讯人工智能实验室);Peking University(北京大学);University of Chinese Academy of Sciences(中国科学院大学);Hong Kong University of Science and Technology(香港科技大学)
Tree Structure-Aware Graph Representation Learning via Integrated Hierarchical Aggregation and Relational Metric Learning
Computer Network Information Center, Chinese Academy of Sciences(中国科学院计算机网络信息中心);University of Chinese Academy of Sciences(中国科学院大学);University of Central Florida(中佛罗里达大学);Alibaba DAMO Academy, Alibaba Group(阿里巴巴达摩院)