Modeling the complex three-dimensional (3D) dynamics of relational systems is an important problem in the natural sciences, with applications ranging from molecular simulations to particle mechanics. Machine learning methods have achieved good success by learning graph neural networks to model spatial interactions. However, these approaches do not faithfully capture temporal correlations since they only model next-step predictions. In this work, we propose Equivariant Graph Neural Operator (EGNO), a novel and principled method that directly models dynamics as trajectories instead of just next-step prediction. Different from existing methods, EGNO explicitly learns the temporal evolution of 3D dynamics where we formulate the dynamics as a function over time and learn neural operators to approximate it. To capture the temporal correlations while keeping the intrinsic SE(3)-equivariance, we develop equivariant temporal convolutions parameterized in the Fourier space and build EGNO by stacking the Fourier layers over equivariant networks. EGNO is the first operator learning framework that is capable of modeling solution dynamics functions over time while retaining 3D equivariance. Comprehensive experiments in multiple domains, including particle simulations, human motion capture, and molecular dynamics, demonstrate the significantly superior performance of EGNO against existing methods, thanks to the equivariant temporal modeling. Our code is available at https://github.com/MinkaiXu/egno.
Enhancing Solutions for Complex PDEs: Introducing Complementary Convolution and Equivariant Attention in Fourier Neural Operators
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
Surrogate Modeling of 3D Rayleigh-Benard Convection with Equivariant Autoencoders
Lamarr Institute for Machine Learning and Artifical Intelligence(拉玛尔机器学习与人工智能研究所);Karlsruhe Institute of Technology(卡尔斯鲁厄理工学院);Department of Computer Science at Paderborn University(帕德博恩大学计算机科学系);Department of Mechanical and Aerospace Engineering Center for Statistics and Machine Learning(机械与航空航天工程系统计与机器学习中心);Princeton University(普林斯顿大学);Department of Computer Science at TU Dortmund University(杜伊斯堡-艾瑟恩理工大学计算机科学系)
Learning local equivariant representations for quantum operators
AI for Science Institute(北京智源人工智能研究院);McGill University(麦吉尔大学);Zhejiang University(浙江大学);National University of Singapore(新加坡国立大学);Birla Institute of Technology & Science, Pilani-Dubai Campus(毕拉理工与科学学院 Pilani 迪拜校区);DP Technology(深势科技);University of Science and Technology of China(中国科学技术大学);Suzhou Institute for Advanced Research, University of Science and Technology of China(中国科学技术大学苏州高等研究院)
FAENet: Frame Averaging Equivariant GNN for Materials Modeling
Mila – Quebec AI Institute(米拉-魁北克人工智能研究所);Université Paris-Saclay(巴黎萨克雷大学);CentraleSupélec(中央理工-高等电力学院);Inria(法国国家信息与自动化研究所);Intel Labs(英特尔实验室);Université de Montréal(蒙特利尔大学);McGill Unversity(麦吉尔大学)
Ophiuchus: Scalable Modeling of Protein Structures through Hierarchical Coarse-graining SO(3)-Equivariant Autoencoders
Center for Bits and Atoms(比特与原子中心);MIT Media Lab, Molecular Machines(麻省理工学院媒体实验室,分子机器);Atomic Architects(原子建筑师);MIT Research Laboratory of Electronics(麻省理工学院电子研究实验室)
Diffusion-EDFs: Bi-equivariant Denoising Generative Modeling on SE(3) for Visual Robotic Manipulation
Yonsei University(延世大学);University of California, Berkeley(加州大学伯克利分校);Samsung Research(三星研究院);Massachusetts Institute of Technology(麻省理工学院);Ewha Womans University(梨花女子大学)
Towards a topological-geometrical theory of group equivariant non-expansive operators for data analysis and machine learning
Champalimaud Research(尚帕利莫研究中心);University of Bologna(博洛尼亚大学);Champalimaud Center for the Unknown(未知领域尚帕利莫研究中心);Advanced Research Center on Electronic System “Ercole De Castro”(电子系统高级研究中心“埃科尔·德·卡斯特罗”);Italian National Research Council, Institute of Information Science and Technologies “Alessandro Faedo”(意大利国家研究委员会信息科学与技术研究所“亚历山德罗·法埃多”)
Stochastic Primal-Dual Three Operator Splitting Algorithm with Extension to Equivariant Regularization-by-Denoising
School of Mathematics, University of Birmingham(伯明翰大学数学学院);Department of Mathematical Sciences, University of Bath(巴斯大学数学科学系);DAMTP, University of Cambridge(剑桥大学应用数学与理论物理系)
本文提出凸三复合优化的随机原始-对偶三算子分裂算法 TOS-SPDHG,证明 O(1/K) 遍历收敛率,并结合 RED 与等变扩展用于成像逆问题。