利用机器学习预测非平稳动力系统的临界点并外推到临界后动力学
Using Machine Learning to Anticipate Tipping Points and Extrapolate to Post-Tipping Dynamics of Non-Stationary Dynamical Systems
摘要:
在本文中,我们考虑预测临界点过渡和长期后临界点行为的机器学习(ML)任务与未知(或部分未知)的时间演化,非平稳,潜在的噪声和混沌,动力系统。我们专注于特别具有挑战性的情况,其中可用于ML训练的过去动态状态时间序列主要位于状态空间的受限区域中,而待预测的行为在训练期间ML模型未完全观察到的较大状态空间集上演变。在这种情况下,需要ML预测系统能够外推到训练期间观察到的不同动态。我们研究了ML方法能够在多大程度上完成这项任务的有用结果,以及它们失败的条件。总的来说,我们发现ML方法即使在非常具有挑战性的情况下也是非常有效的,但是当需要“太多”外推时(正如人们所期望的那样)会失败。对于后一种情况,我们研究了ML方法与基于科学知识的传统建模相结合的有效性,从而形成了一个混合预测系统,我们发现即使其基于ML和基于知识的组件在单独行动时失败,也可以进行有用的预测。我们还发现,实现有用的结果可能需要使用非常仔细选择的ML超参数,我们提出了一个超参数优化策略来解决这个问题。本文的主要结论是,基于ML的方法是有前途的工具,用于预测非平稳动态系统的行为,即使在这种情况下,未来的演变(也许是由于交叉的临界点)包括动态以外的一组探索的训练数据。
英文摘要:
In this paper we consider the machine learning (ML) task of predicting tipping point transitions and long-term post-tipping-point behavior associated with the time evolution of an unknown (or partially unknown), non-stationary, potentially noisy and chaotic, dynamical system. We focus on the particularly challenging situation where the past dynamical state time series that is available for ML training predominantly lies in a restricted region of the state space, while the behavior to be predicted evolves on a larger state space set not fully observed by the ML model during training. In this situation, it is required that the ML prediction system have the ability to extrapolate to different dynamics past that which is observed during training. We investigate the extent to which ML methods are capable of accomplishing useful results for this task, as well as conditions under which they fail. In general, we found that the ML methods were surprisingly effective even in situations that were extremely challenging, but do (as one would expect) fail when ``too much" extrapolation is required. For the latter case, we investigate the effectiveness of combining the ML approach with conventional modeling based on scientific knowledge, thus forming a hybrid prediction system which we find can enable useful prediction even when its ML-based and knowledge-based components fail when acting alone. We also found that achieving useful results may require using very carefully selected ML hyperparameters and we propose a hyperparameter optimization strategy to address this problem. The main conclusion of this paper is that ML-based approaches are promising tools for predicting the behavior of non-stationary dynamical systems even in the case where the future evolution (perhaps due to the crossing of a tipping point) includes dynamics on a set outside of that explored by the training data.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。