In recent years, graph neural networks (GNNs) have facilitated the development of graph data mining. However, training GNNs requires sufficient labeled task-specific data, which is expensive and sometimes unavailable. To be less dependent on labeled data, recent studies propose to pre-train GNNs in a self-supervised manner and then apply the pre-trained GNNs to downstream tasks with limited labeled data. However, most existing methods are designed solely for homogeneous graphs (real-world graphs are mostly heterogeneous) and do not consider semantic mismatch (the semantic difference between the original data and the ideal data containing more transferable semantic information). In this paper, we propose an effective framework to pre-train GNNs on the large-scale heterogeneous graph. We first design a structure-aware pre-training task, which aims to capture structural properties in heterogeneous graphs. Then, we design a semantic-aware pre-training task to tackle the mismatch. Specifically, we construct a perturbation subspace composed of semantic neighbors to help deal with the semantic mismatch. Semantic neighbors make the model focus more on the general knowledge in the semantic space, which in turn assists the model in learning knowledge with better transferability. Finally, extensive experiments are conducted on real-world large-scale heterogeneous graphs to demonstrate the superiority of the proposed method over state-of-the-art baselines. Code available at https://github.com/sunshy-1/PHE.
Scalable Heterogeneous Graph Foundation Models for Data-Driven Optimal Power Flow in Smart Grids
Computational Sciences and Engineering Division, Oak Ridge National Laboratory(橡树岭国家实验室计算科学与工程部);Mathematics and Computer Science Division, Argonne National Laboratory(阿贡国家实验室数学与计算机科学部);UT-Battelle, LLC(UT-巴特勒公司)
Top K Enhanced Reinforcement Learning Attacks on Heterogeneous Graph Node Classification
School of Electrical and Electronic Engineering(电子与电气工程学院);Nanyang Technological University(南洋理工大学);Singapore Institute of Manufacturing Technology (SIMTech)(新加坡制造技术研究所)
Central China Normal University Wollongong Joint Institute(华中师范大学伍伦贡联合研究院);Central China Normal University(华中师范大学);Faculty of Artificial Intelligence in Education, Central China Normal University(华中师范大学人工智能教育学部)
Towards Performance-Enhanced Model-Contrastive Federated Learning using Historical Information in Heterogeneous Scenarios
Key Laboratory of Computing Power Network and Information Security, Ministry of Education, Shandong Computer Science Center, Qilu University of Technology (Shandong Academy of Sciences)(计算能力网络与信息安全重点实验室,教育部,山东计算机科学中心,齐鲁工业大学(山东科学院));School of Information and Software Engineering, University of Electronic Science and Technology of China(信息与软件工程学院,电子科技大学);School of Computer Science and Engineering, Shandong University of Science and Technology(计算机科学与工程学院,山东科技大学);School of Big Data and Software Engineering, Chongqing University(大数据与软件工程学院,重庆大学)
Graph-Driven Models for Gas Mixture Identification and Concentration Estimation on Heterogeneous Sensor Array Signals
School of Electrical and Electronic Engineering, Nanyang Technological University(南洋理工大学电气与电子工程学院);College of Electronic and Information Engineering, Tongji University(同济大学电子与信息工程学院);School of Civil Engineering, Yancheng Institute of Technology(盐城工学院土木工程学院)
Prediction of ESG Compliance using a Heterogeneous Information Network
Social ICT Research Center(社会信息通信技术研究中心);Graduate School of Information Science and Technology(信息科学与技术研究生院);The University of Tokyo(东京大学);ETH Zürich(苏黎世联邦理工学院);National Institute of Informatics(国立信息学研究所)
FedTGP: Trainable Global Prototypes with Adaptive-Margin-Enhanced Contrastive Learning for Data and Model Heterogeneity in Federated Learning
Shanghai Jiao Tong University(上海交通大学);Institute for AI Industry Research, Tsinghua University(清华大学智能产业研究院);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Queen’s University Belfast(英国女王大学)
Filling the Missing: Exploring Generative AI for Enhanced Federated Learning over Heterogeneous Mobile Edge Devices
University of Macau(澳门大学);Zhejiang University of Technology(浙江工业大学);Guangdong University of Technology(广东工业大学);Nanyang Technological University(南洋理工大学);University of Waterloo(滑铁卢大学)
Knowledge-Enhanced Semi-Supervised Federated Learning for Aggregating Heterogeneous Lightweight Clients in IoT
Pennsylvania State University(宾夕法尼亚州立大学);University of Electronic Science and Technology of China(电子科技大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Purdue University(普渡大学);Georgia State University(佐治亚州立大学)
Learning Memory-Enhanced Improvement Heuristics for Flexible Job Shop Scheduling
Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education(教育部符号计算与知识工程重点实验室);College of Software(软件学院);College of Computer Science and Technology(计算机科学与技术学院);Singapore Management University(新加坡管理大学);Nanyang Technological University(南洋理工大学)
Heterogeneous Hypergraph Embedding for Recommendation Systems
Griffith University(格里菲斯大学);Hanoi University of Science and Technology(河内科技大学);Ecole Polytechnique Federale de Lausanne(洛桑联邦理工学院);The University of Queensland(昆士兰大学)