Rethinking Graph Neural Networks for the Graph Coloring Problem
Carnegie Mellon University(卡内基梅隆大学);The Chinese University of Hong Kong(香港中文大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));The University of Texas at Austin(德克萨斯大学奥斯汀分校)
Wei Li, Ruxuan Li, Yuzhe Ma, Siu On Chan, David Pan, Bei Yu
Graph coloring, a classical and critical NP-hard problem, is the problem of assigning connected nodes as different colors as possible. However, we observe that state-of-the-art GNNs are less successful in the graph coloring problem. We analyze the reasons from two perspectives. First, most GNNs fail to generalize the task under homophily to heterophily, i.e., graphs where connected nodes are assigned different colors. Second, GNNs are bounded by the network depth, making them possible to be a local method, which has been demonstrated to be non-optimal in Maximum Independent Set (MIS) problem. In this paper, we focus on the aggregation-combine GNNs (AC-GNNs), a popular class of GNNs. We first define the power of AC-GNNs in the coloring problem as the capability to assign nodes different colors. The definition is different with previous one that is based on the assumption of homophily. We identify node pairs that AC-GNNs fail to discriminate. Furthermore, we show that any AC-GNN is a local coloring method, and any local coloring method is non-optimal by exploring the limits of local methods over sparse random graphs, thereby demonstrating the non-optimality of AC-GNNs due to its local property. We then prove the positive correlation between model depth and its coloring power. Moreover, we discuss the color equivariance of graphs to tackle some practical constraints such as the pre-fixing constraints. Following the discussions above, we summarize a series of rules a series of rules that make a GNN color equivariant and powerful in the coloring problem. Then, we propose a simple AC-GNN variation satisfying these rules. We empirically validate our theoretical findings and demonstrate that our simple model substantially outperforms state-of-the-art heuristic algorithms in both quality and runtime.
NN-Former: Rethinking Graph Structure in Neural Architecture Representation
State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University(多媒体信息处理国家重点实验室,计算机学院,北京大学);Northwestern Polytechnical University(西北工业大学);Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳))
Rethinking Input Domains in Physics-Informed Neural Networks via Geometric Compactification Mappings
School of Information and Software Engineering, University of Electronic Science and Technology of China(信息与软件工程学院,电子科学与技术大学);Computer Science and Engineering, University of Electronic Science and Technology of China(计算机科学与工程,电子科学与技术大学);Institute of Software Chinese Academy of Sciences, Beijing, China(软件研究所,中国科学院北京);School of Robotics and Advanced Manufacture, Harbin Institute of Technology, Shenzhen, China(机器人与先进制造学院,哈尔滨工业大学深圳)
Rethinking Graph Neural Networks for Anomaly Detection
Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Hong Kong University of Science and Technology(香港科技大学);Stanford University(斯坦福大学)
Rethinking Influence Functions of Neural Networks in the Over-parameterized Regime
Academy of Mathematics and Systems Science, Chinese Academy of Sciences(中国科学院数学与系统科学研究院);School of Mathematical Sciences, University of Chinese Academy of Sciences(中国科学院大学数学科学学院)
Rethinking Causal Relationships Learning in Graph Neural Networks
Science and Technology on Integrated Information System Laboratory, Institute of Software Chinese Academy of Sciences(中国科学院软件研究所综合信息系统技术国家级重点实验室);University of Chinese Academy of Sciences(中国科学院大学);State Key Laboratory of Intelligent Game(智能博弈国家重点实验室);Department of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术系)
Graph Coloring with Physics-Inspired Graph Neural Networks
Amazon Quantum Solutions Lab(亚马逊量子解决方案实验室);AWS Intelligent and Advanced Compute Technologies, Professional Services(AWS智能与高级计算技术专业服务部);AWS Center for Quantum Computing(AWS量子计算中心)
Tango: rethinking quantization for graph neural network training on GPUs
Rutgers, The State University of New Jersey(罗格斯,新泽西州立大学);Amazon(亚马逊);University of Connecticut(康涅狄格大学);Institution of Software, Chinese Academy of Sciences(中国科学院软件研究所);University of North Texas(北德克萨斯大学)
GL-Fusion: Rethinking the Combination of Graph Neural Network and Large Language model
Institute for Artificial Intelligence, Peking University(北京大学人工智能研究院);School of Intelligence Science and Technology, Peking University(北京大学智能科学与技术学院);Alibaba Group(阿里巴巴集团)
From Scalars to Time Series: Rethinking Implicit Neural Representations for Time-Varying Volumetric Data
School of Computer Science and Engineering, Sun Yat-sen University(中山大学计算机科学与工程学院);Department of Computer Science, Hong Kong Baptist University(香港浸会大学计算机科学系);Guangdong Province Key Laboratory of Computational Science(广东省计算科学重点实验室);National Supercomputer Center in Guangzhou(广州国家超级计算中心)
Rethinking Generalization in Graph Neural Networks: A Structural Complexity Perspective
Institute of Intelligent Information Processing(智能信息处理研究院);Shanxi University(山西大学);Alliance Manchester Business School University of Manchester(曼彻斯特大学曼彻斯特商业学院);University of Manchester(曼彻斯特大学);Department of Mathematics(数学系);Hong Kong Baptist University(香港 Baptist 大学)
Rethinking Parameter Sharing as Graph Coloring for Structured Compression
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);Peng Cheng Laboratory(鹏城实验室)
Rethinking Loss Reweighting for Imbalance Learning as an Inverse Problem: A Neural Collapse Point of View
CSMT, Wenzhou-Kean University(温州肯恩大学计算机科学与技术学院);International Frontier Interdisciplinary Research Institute, Wenzhou-Kean University(温州肯恩大学国际前沿交叉研究 institutes)
Rethinking Constraint Awareness for Efficient State Embedding of Neural Routing Solver
College of Computer Science and Software Engineering, Shenzhen University(深圳大学计算机科学与软件工程学院);School of Automation and Intelligent Manufacturing, Southern University of Science and Technology(南方科技大学自动化与智能制造学院);Guangdong Provincial Key Laboratory of Fully Actuated System Control Theory and Technology, Southern University of Science and Technology(广东省全驱动系统控制理论与技术重点实验室,南方科技大学);Pengcheng Laboratory(鹏城实验室)
Rethinking Neural Width for Alternating Current Optimal Power Flow Proxies
Department of Electrical Engineering, National Institute of Technology Kurukshetra, India(印度克什米尔国立理工学院电气工程系);Indraprastha Institute of Information Technology Delhi, India(印度德里印度理工信息学院);Department of Electrical Engineering, Indian Institute of Technology Roorkee, India(印度罗尔基印度理工学院电气工程系)
Rethinking Calibration for Early-Exit Neural Networks
Jagiellonian University(雅盖隆大学);Warsaw University of Technology(华沙理工大学);IDEAS Research Institute(IDEAS研究院);Johns Hopkins University(约翰霍普金斯大学);Doctoral School of Exact and Natural Sciences(精确与自然科学博士学院)
RESCHED: Rethinking Flexible Job Shop Scheduling from a Transformer-based Architecture with Simplified States
School of Computing and Information Systems, Singapore Management University, Singapore(新加坡管理大学计算机与信息系);College of Computing and Data Science, Nanyang Technological University, Singapore(南洋理工大学计算与数据科学学院);Institute of Marine Science and Technology, Shandong University, China(山东大学海洋科学与技术研究院)