In the field of domain generalization, the task of constructing a predictive model capable of generalizing to a target domain without access to target data remains challenging. This problem becomes further complicated when considering evolving dynamics between domains. While various approaches have been proposed to address this issue, a comprehensive understanding of the underlying generalization theory is still lacking. In this study, we contribute novel theoretic results that aligning conditional distribution leads to the reduction of generalization bounds. Our analysis serves as a key motivation for solving the Temporal Domain Generalization (TDG) problem through the application of Koopman Neural Operators, resulting in Temporal Koopman Networks (TKNets). By employing Koopman Operators, we effectively address the time-evolving distributions encountered in TDG using the principles of Koopman theory, where measurement functions are sought to establish linear transition relations between evolving domains. Through empirical evaluations conducted on synthetic and real-world datasets, we validate the effectiveness of our proposed approach.
P-K-GCN: Physics-augmented Koopman-enhanced Graph Convolutional Network for Deep Spatiotemporal Super-resolution
Department of Industrial & Systems Engineering, The University of Tennessee, Knoxville, TN, USA(工业与系统工程系,田纳西大学, Knoxville,TN,美国);Charles F. Dolan School of Business, Fairfield University, Fairfield, USA(查尔斯·F·多兰商学院,费尔菲尔德大学, Fairfield,美国);Department of Electrical Engineering & Computer Science, The University of Tennessee, Knoxville, TN, USA(电气工程与计算机科学系,田纳西大学, Knoxville,TN,美国)
Interpreting Temporal Graph Neural Networks with Koopman Theory
UiT The Arctic University of Norway, Department of Mathematics and Statistics(挪威北极大学数学与统计系);Sapienza Università di Roma, Department of Information Engineering, Electronics and Telecommunications(罗马大学信息工程、电子与电信系);NORCE Norwegian Research Centre AS(挪威研究中心AS)
Transformer with Koopman-Enhanced Graph Convolutional Network for Spatiotemporal Dynamics Forecasting
Charles F. Dolan School of Business, Fairfield University(Fairfield大学商学院);Department of Industrial & Systems Engineering, The University of Tennessee(田纳西大学工业与系统工程系)
Recurrent neural networks and Koopman-based frameworks for temporal predictions in a low-order model of turbulence
University of Tehran(德黑兰大学);KTH Royal Institute of Technology(瑞典皇家理工学院);Swedish e-Science Research Centre (SeRC)(瑞典e-Science研究中心)
Moehlis等人(New J. Phys. 6,56,2004)在预测近壁湍流低阶模型的时间动力学中评估了循环神经网络和基于Koopman的框架的能力。我们的研究结果表明,有可能获得良好的长期统计和混沌系统的动态行为的再现与适当训练的长短期记忆(LSTM)网络,导致相对误差的平均值和波动低于$1\%$。此外,一个新开发的基于Koopman的框架,称为Koopman与非线性强迫(KNF),导致相同水平的准确性的统计数据在一个显着降低计算费用。此外,KNF框架在短期预测方面优于LSTM网络。我们还观察到,使用的损失函数的基础上的混沌系统的瞬时预测可以导致次优再现长期统计。因此,我们提出了一个模型选择标准的基础上计算的统计,它允许实现良好的统计重建,即使在小的数据集,在瞬时预测的准确性损失最小。
DeepKoopFormer: A Koopman Enhanced Transformer Based Architecture for Time Series Forecasting
Helmholtz Center for Environmental Research-UFZ(海德堡环境研究中心-UFZ);Delft Center for Systems and Control(代尔夫特系统与控制中心);School of Engineering, University of Pittsburgh(匹兹堡大学工程学院)
Learning the Koopman Operator using Attention Free Transformers
Institute for Bioengineering, School of Engineering and Centre for Engineering Biology, University of Edinburgh(爱丁堡大学生物工程研究所、工程学院与工程生物学中心);Electrical and Computer Engineering and Applied Mathematics, University of Washington(华盛顿大学电气与计算机工程与应用数学系);Electrical and Computer Engineering and Computer Science & Engineering, University of Washington(华盛顿大学电气与计算机工程及计算机科学与工程系)
LTL2Action: Generalizing LTL Instructions for Multi-Task RL
University of Toronto(多伦多大学);Vector Institute for Artificial Intelligence(向量人工智能研究所);Schwartz Reisman Institute for Technology and Society(施瓦茨·赖斯曼技术与社会研究所)
Generalizing Multi-Scale Time-Series Modeling with a Single Operator
School of Electrical Engineering, KAIST, Daejeon, Republic of Korea(韩国成均馆大学电子工程学院);Department of Computer Science and Engineering, Seoul National University, Seoul, Republic of Korea(首尔国立大学计算机科学与工程系)
Toward Scalable SDN for LEO Mega-Constellations: A Graph Learning Approach
School of Electrical and Mechanical Engineering, University of Adelaide(阿德莱德大学电气与机械工程学院);College of Computing and Informatics, University of Sharjah(沙迦大学计算机与信息学院);Singapore University of Technology and Design(新加坡科技与设计大学);Electronics and Telecommunications Research Institute(电子电信研究所)
本文提出一种可扩展的分层 SDN 框架,利用图神经网络和 Koopman 理论来优化低轨 mega-星座的网络管理,实验证明在空间压缩和时间预测方面有显著提升。
FreKoo++: Learning Continuous Spectral Dynamics for Temporal Domain Generalization
Australian Artificial Intelligence Institute (AAII)(澳大利亚人工智能研究所(AAII));Faculty of Engineering and Information Technology(工程与信息技术学院);University of Technology Sydney (UTS)(悉尼科技大学(UTS))