Department of Artificial Intelligence, School of Engineering, Westlake University(人工智能系,工程学院,西湖大学);Academy of Mathematics and Systems Science, Chinese Academy of Sciences(数学系统科学学院,中国科学院);Fudan University(复旦大学);South China University of Technology(华南理工大学);Microsoft AI4Science(微软AI4Science)
Peiyan Hu, Rui Wang, Xiang Zheng, Tao Zhang, Haodong Feng, Ruiqi Feng, Long Wei, Yue Wang, Zhi-Ming Ma, Tailin Wu
Simulating and controlling physical systems described by partial differential equations (PDEs) are crucial tasks across science and engineering. Recently, diffusion generative models have emerged as a competitive class of methods for these tasks due to their ability to capture long-term dependencies and model high-dimensional states. However, diffusion models typically struggle with handling system states with abrupt changes and generalizing to higher resolutions. In this work, we propose Wavelet Diffusion Neural Operator (WDNO), a novel PDE simulation and control framework that enhances the handling of these complexities. WDNO comprises two key innovations. Firstly, WDNO performs diffusion-based generative modeling in the wavelet domain for the entire trajectory to handle abrupt changes and long-term dependencies effectively. Secondly, to address the issue of poor generalization across different resolutions, which is one of the fundamental tasks in modeling physical systems, we introduce multi-resolution training. We validate WDNO on five physical systems, including 1D advection equation, three challenging physical systems with abrupt changes (1D Burgers' equation, 1D compressible Navier-Stokes equation and 2D incompressible fluid), and a real-world dataset ERA5, which demonstrates superior performance on both simulation and control tasks over state-of-the-art methods, with significant improvements in long-term and detail prediction accuracy. Remarkably, in the challenging context of the 2D high-dimensional and indirect control task aimed at reducing smoke leakage, WDNO reduces the leakage by 78% compared to the second-best baseline. The code can be found at https://github.com/AI4Science-WestlakeU/wdno.git.
VDW-GNNs: Vector diffusion wavelets for geometric graph neural networks
Program in Computing, Boise State University, Boise, Idaho, USA(博伊西州立大学计算项目);Department of Mathematics, UCLA, Los Angeles, CA, USA(洛杉矶大学数学系);Department of Computer Science, Yale University, New Haven, CT, USA(耶鲁大学计算机科学系);Department of Genetics, Yale University, New Haven, CT, USA(耶鲁大学遗传学系);Department of Mathematics, Boise State University, Boise, Idaho, USA(博伊西州立大学数学系)