Graph Neural Networks (GNNs) have demonstrated remarkable success in modeling complex relationships in graph-structured data. A recent innovation in this field is the family of Differential Equation-Inspired Graph Neural Networks (DE-GNNs), which leverage principles from continuous dynamical systems to model information flow on graphs with built-in properties such as feature smoothing or preservation. However, existing DE-GNNs rely on first or second-order temporal dependencies. In this paper, we propose a neural extension to those pre-defined temporal dependencies. We show that our model, called TDE-GNN, can capture a wide range of temporal dynamics that go beyond typical first or second-order methods, and provide use cases where existing temporal models are challenged. We demonstrate the benefit of learning the temporal dependencies using our method rather than using pre-defined temporal dynamics on several graph benchmarks.
State Key Laboratory of Multimodal Artificial Intelligence Systems Institute of Automation, Chinese Academy of Sciences(多模态人工智能系统国家重点实验室 中国科学院自动化研究所);School of Artificial Intelligence University of Chinese Academy of Sciences(中国科学院自动化研究所人工智能学院)
Self-Aware Vector Embeddings for Retrieval-Augmented Generation: A Neuroscience-Inspired Framework for Temporal, Confidence-Weighted, and Relational Knowledge
CoDCL: Counterfactual-Inspired Augmentation Contrastive Learning for Temporal Link Prediction in Social Networks
Jiangsu Key Laboratory of Net-Worked Collective Intelligence, School of Cyber Science and Engineering, Southeast University(江苏网络集体智能重点实验室,网络安全科学与工程学院,东南大学);School of Mathematics, Southeast University(数学学院,东南大学);Frontiers Science Center for Mobile Information Communication and Security, School of Mathematics, Southeast University(移动信息通信与安全前沿科学中心,数学学院,东南大学);Purple Mountain Laboratories(紫金山实验室)
Consciousness-Inspired Spatio-Temporal Abstractions for Better Generalization in Reinforcement Learning
McGill University(麦吉尔大学);Microsoft Research Montreal(微软研究院蒙特利尔分部);Université de Montréal(蒙特利尔大学);Mila(米拉研究所);Sony AI(索尼人工智能公司);Google DeepMind(谷歌DeepMind)
FlyPrompt: Brain-Inspired Random-Expanded Routing with Temporal-Ensemble Experts for General Continual Learning
School of Life Sciences, IDG/McGovern Institute for Brain Research, Tsinghua University(生命科学学院,IDG/麦克格雷文脑科学研究院,清华大学);Department of Psychological and Cognitive Sciences, Tsinghua University(心理学与认知科学系,清华大学);School of Medicine, Shenzhen Campus of Sun Yat-Sen University(中山大学深圳校区医学学院)
McGovern Brain Imaging Institute, State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University(北京师范大学认知神经科学与学习国家重点实验室麦戈文脑成像研究所);Tsinghua University(清华大学);Nanjing University of Aeronautics and Astronautics(南京航空航天大学);Georgia Institute of Technology(佐治亚理工学院);Emory University(埃默里大学);Georgia State University(佐治亚州立大学);Beijing Normal University(北京师范大学)
ProGen: Revisiting Probabilistic Spatial-Temporal Time Series Forecasting from a Continuous Generative Perspective Using Stochastic Differential Equations
Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州))
Speech Emotion Recognition Using Deep Sparse Auto-Encoder Extreme Learning Machine with a New Weighting Scheme and Spectro-Temporal Features Along with Classical Feature Selection and A New Quantum-Inspired Dimension Reduction Method
Differential Privacy of Quantum and Quantum-Inspired Classical Recommendation Algorithms
Key Laboratory of System Software, CAS(系统软件重点实验室,中国科学院);University of Chinese Academy of Sciences(中国科学院大学);Centre for Quantum Software and Information(量子软件与信息中心);University of Technology Sydney(悉尼大学)
Unlearning on Spatio-Temporal Graphs through Subgraph Virtual Edge Reconstruction
Texas A&M University - Corpus Christi(德州农工大学科珀斯克里斯蒂分校);Delft University of Technology(代尔夫特理工大学);University of Texas at San Antonio(德克萨斯大学圣安东尼奥分校);Biogen(渤健公司)
Interpretable Spatio-Temporal Embedding for Brain Structural-Effective Network with Ordinary Differential Equation
University of Texas Rio Grande Valley(德克萨斯大学里奥格兰德河谷分校);University of Maryland(马里兰大学);University of Pittsburgh(匹兹堡大学);Texas A&M University - Corpus Christi(德克萨斯农工大学科珀斯克里斯蒂分校);Emory University(埃默里大学);Lehigh University(利哈伊大学);University of Illinois at Chicago(芝加哥伊利诺伊大学);University of Southern California(南加州大学)
Scintillation pulse characterization with spectrum-inspired temporal neural networks: case studies on particle detector signals
PLAC, Key Laboratory of Quark and Lepton Physics (MOE)(PLAC,夸克与轻子物理国家重点实验室);Central China Normal University(中部师范大学);Hubei Provincial Engineering Research Center of Silicon Pixel Chip & Detection Technology(湖北省硅像素芯片与探测技术工程研究中心);Key Laboratory of Particle and Radiation Imaging (MOE), Department of Engineering Physics(粒子与辐射成像国家重点实验室,工程物理系);Tsinghua University(清华大学)