When GNNs meet symmetry in ILPs: an orbit-based feature augmentation approach
School of Science and Engineering, The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳)理工学院);Shenzhen International Center for Industrial and Applied Mathematics(深圳国际工业与应用数学中心);Shenzhen Research Institute of Big Data(深圳大数据研究院);School of Data Science, The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳)数据科学学院);School of Artificial Intelligence, The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳)人工智能学院);School of Software Engineering, Tongji University, Shanghai(同济大学软件学院)
Qian Chen, Lei Li, Qian Li, Jianghua Wu, Akang Wang, Ruoyu Sun, Xiaodong Luo, Tsung-Hui Chang, Qingjiang Shi
A common characteristic in integer linear programs (ILPs) is symmetry, allowing variables to be permuted without altering the underlying problem structure. Recently, GNNs have emerged as a promising approach for solving ILPs. However, a significant challenge arises when applying GNNs to ILPs with symmetry: classic GNN architectures struggle to differentiate between symmetric variables, which limits their predictive accuracy. In this work, we investigate the properties of permutation equivariance and invariance in GNNs, particularly in relation to the inherent symmetry of ILP formulations. We reveal that the interaction between these two factors contributes to the difficulty of distinguishing between symmetric variables. To address this challenge, we explore the potential of feature augmentation and propose several guiding principles for constructing augmented features. Building on these principles, we develop an orbit-based augmentation scheme that first groups symmetric variables and then samples augmented features for each group from a discrete uniform distribution. Empirical results demonstrate that our proposed approach significantly enhances both training efficiency and predictive performance.
Feature Augmentation of GNNs for ILPs: Local Uniqueness Suffices
School of Science and Engineering, The Chinese University of Hong Kong, Shenzhen, China(深圳大学理工学院,香港中文大学(深圳));Shenzhen International Center for Industrial and Applied Mathematics, Shenzhen Research Institute of Big Data, China(深圳国际工业与应用数学中心,深圳大数据研究院);School of Data Science, The Chinese University of Hong Kong, Shenzhen, China(数据科学学院,香港中文大学(深圳));School of Software Engineering, Tongji University, Shanghai, China(软件工程学院,同济大学)
Large Language Models Meet Graph Neural Networks: A Perspective of Graph Mining
School of Computer Science and Engineering(计算机科学与工程学院);University of Electronic Science and Technology of China(电子科技大学);th Research Institute of CETC(中国电子科技集团公司第五十四研究所)
Indian Institute of Information Technology Kottayam (IIITK)(印度信息技术学院科塔亚姆分校(IIITK));International Institute of Information Technology Hyderabad (IIITH)(印度信息技术学院海得拉巴分校(IIITH))
KTH Royal Institute of Technology(皇家理工学院);University of Peloponnese(伯罗奔尼撒大学);University of Luxembourg(卢森堡大学);Ecole Polytechnique, IP Paris(巴黎综合理工学院(巴黎IP))
GCoDE: Efficient Device-Edge Co-Inference for GNNs via Architecture-Mapping Co-Search
School of Software, Beihang University(北京航空航天大学软件学院);School of Computer Science and Engineering, Beihang University(北京航空航天大学计算机科学与工程学院);Qingdao Research Institute, Beihang University(北京航空航天大学青岛研究院);School of Computer Science and Engineering, Peking University(北京大学计算机科学与工程学院);School of Integrated Circuits and Engineering, Beihang University(北京航空航天大学集成电路与工程学院)
CERN(欧洲核子研究中心);University of L'Aquila(拉奎拉大学);University of Trieste(的里雅斯特大学);University of Genoa(热那亚大学);Sapienza University(罗马大学);Policlinico Universitario Agostino Gemelli(阿戈斯蒂诺·杰梅利大学综合医院)
When Vision Meets Graphs: A Survey on Graph Reasoning and Learning
The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));University of Waterloo(滑铁卢大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Oxford(牛津大学)
Knowledge Graphs Meet Graph Neural Networks: A Comprehensive Survey
School of Safety Engineering, China University of Mining and Technology(中国矿业大学安全工程学院);School of Computer Science and Technology, China University of Mining and Technology(中国矿业大学计算机科学与技术学院);State Key Laboratory of Coal Mine Disaster Prevention and Control, China University of Mining and Technology(中国矿业大学煤矿灾害防治国家重点实验室);Department of Computer Science, University of Illinois at Chicago(伊利诺伊大学芝加哥分校计算机科学系)
Survey of Graph Neural Network for Internet of Things and NextG Networks
Marconi-Rosenblatt AI Innovation Laboratory(马科尼-罗森布劳特人工智能创新实验室);ANDRO Computational Solutions LLC(ANDRO计算解决方案有限公司);Department of Electrical Engineering University at Buffalo, The State University of New York(大学伯克利电气工程系,纽约州立大学)
Contrastive Learning Meets Pseudo-label-assisted Mixup Augmentation: A Comprehensive Graph Representation Framework from Local to Global
School of Information Science and Technology, Beijing University of Technology(北京工业大学信息科学与技术学院);The University of Sydney Business School, The University of Sydney(悉尼大学商学院);College of Information Science and Technology, Beijing University of Chemical Technology(北京化工大学信息科学与技术学院)
Invariant Graph Learning Meets Information Bottleneck for Out-of-Distribution Generalization
School of Cyber Science and Technology, University of Science and Technology of China(中国科学技术大学网络空间安全学院);Tencent(腾讯);School of Artificial Intelligence and Data Science, University of Science and Technology of China(中国科学技术大学人工智能与数据科学学院)