arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2304.07485cs.LGcs.AIcs.NAmath.NA
收藏

面向未知动力系统鲁棒演化算子学习的关键采样

Critical Sampling for Robust Evolution Operator Learning of Unknown Dynamical Systems

Carnegie Mellon University(卡内基梅隆大学);Southern University of Science and Technology(南方科技大学);Pengcheng Laboratory(鹏城实验室)

Ce Zhang, Kailiang Wu, Zhihai He

AI总结:

本文针对未知动力系统样本效率问题,提出基于多步互逆预测误差的关键采样方法,并结合时空演化网络,在极少样本下实现系统演化算子的鲁棒学习与准确预测。

摘要:

给定一个未知动力系统,为了有效学习其控制规律并准确预测其未来演化行为,所需的最少样本数量是多少?又应如何选取这些关键样本?在本工作中,我们提出基于一种设计方法来探索该问题。从一个较小的初始样本集出发,我们自适应地发现关键样本,以实现对系统演化越来越准确的学习。这里的一个核心挑战在于,由于真实系统状态未知,我们无法获知网络建模误差,而该误差对于关键采样又是必需的。为应对这一挑战,我们引入了一个多步互逆预测网络,其中前向演化网络和后向演化网络分别被设计用于学习时间正向和时间反向上的时间演化行为。非常有趣的是,我们发现所需的网络建模误差与多步互逆预测误差高度相关,而后者可以直接从当前系统状态计算得到。这使得我们能够针对动力系统,从具有较高网络建模误差的区域中动态选择关键样本。此外,我们还引入了一个联合时空演化网络,将空间动力学建模纳入时间演化预测中,从而在少量样本条件下实现对系统演化算子的鲁棒学习。大量实验结果表明,我们所提出的方法能够将未知动力系统有效学习和准确预测演化行为所需的样本数量大幅减少,最高可达数百倍。

英文摘要:

Given an unknown dynamical system, what is the minimum number of samples needed for effective learning of its governing laws and accurate prediction of its future evolution behavior, and how to select these critical samples? In this work, we propose to explore this problem based on a design approach. Starting from a small initial set of samples, we adaptively discover critical samples to achieve increasingly accurate learning of the system evolution. One central challenge here is that we do not know the network modeling error since the ground-truth system state is unknown, which is however needed for critical sampling. To address this challenge, we introduce a multi-step reciprocal prediction network where forward and backward evolution networks are designed to learn the temporal evolution behavior in the forward and backward time directions, respectively. Very interestingly, we find that the desired network modeling error is highly correlated with the multi-step reciprocal prediction error, which can be directly computed from the current system state. This allows us to perform a dynamic selection of critical samples from regions with high network modeling errors for dynamical systems. Additionally, a joint spatial-temporal evolution network is introduced which incorporates spatial dynamics modeling into the temporal evolution prediction for robust learning of the system evolution operator with few samples. Our extensive experimental results demonstrate that our proposed method is able to dramatically reduce the number of samples needed for effective learning and accurate prediction of evolution behaviors of unknown dynamical systems by up to hundreds of times.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑