Learning a stable Linear Dynamical System (LDS) from data involves creating models that both minimize reconstruction error and enforce stability of the learned representation. We propose a novel algorithm for learning stable LDSs. Using a recent characterization of stable matrices, we present an optimization method that ensures stability at every step and iteratively improves the reconstruction error using gradient directions derived in this paper. When applied to LDSs with inputs, our approach---in contrast to current methods for learning stable LDSs---updates both the state and control matrices, expanding the solution space and allowing for models with lower reconstruction error. We apply our algorithm in simulations and experiments to a variety of problems, including learning dynamic textures from image sequences and controlling a robotic manipulator. Compared to existing approaches, our proposed method achieves an orders-of-magnitude improvement in reconstruction error and superior results in terms of control performance. In addition, it is provably more memory-efficient, with an O(n^2) space complexity compared to O(n^4) of competing alternatives, thus scaling to higher-dimensional systems when the other methods fail.
STAMP: Outlier-Aware Test-Time Adaptation with Stable Memory Replay
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);University of Science and Technology of China(中国科学技术大学)
climt-paraformer: Stable Emulation of Convective Parameterization using a Temporal Memory-aware Transformer
Sustainability and Data Sciences Laboratory, Northeastern University(可持续性与数据科学实验室,东北大学);Microsoft(微软);Indian Institute of Science Education and Research Pune(印度科学教育与研究中心普纳分校);AI for Climate and Sustainability, The Institute for Experiential AI, Northeastern University(气候与可持续性人工智能,体验式人工智能研究所,东北大学)
Stochastic Dimension Zeroth-Order Estimator: Stable and Memory-Efficient Training of PINNs
Tianjin University National Center for Applied Mathematics(天津大学应用数学中心);Jilin University School of Mechanical and Aerospace Engineering(吉林大学机械与 aerospace 工程学院)
Sparse-RL: Breaking the Memory Wall in LLM Reinforcement Learning via Stable Sparse Rollouts
School of Information, Renmin University of China(中国人民大学信息学院);Key Laboratory of Data Engineering and Knowledge Engineering(数据工程与知识工程重点实验室);Ant Group(蚂蚁集团)