arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2304.01708stat.MLcs.LGcs.SYeess.SYmath.STstat.TH
收藏

高维线性高斯系统的学习与集中不等式:不变子空间方法

Learning and Concentration for High Dimensional Linear Gaussians: an Invariant Subspace Approach

Duke University(杜克大学)

Muhammad Abdullah Naeem

AI总结:

本文研究了带各向同性高斯噪声的稳定线性系统时间实现间相关性的非渐近界,利用不变子空间方法揭示了高维下特征值重数差异导致的系统瓶颈现象,为随机动态系统的学习与集中提供了首个几何解释。

摘要:

在这项工作中,我们研究了具有各向同性高斯噪声的稳定线性系统的两个时间实现之间相关性的非渐近界。因此,通过从子轨迹中采样并使用Talagrands'不等式,我们证明了奖励的经验平均值以高概率集中在稳态(当闭环系统在线性反馈策略下稳定时,动态系统混合到的状态)奖励周围。与谱半径越大样本间相关性越强的普遍看法相反,系统特征值的代数重数与几何重数之间的巨大差异导致了与系统转移矩阵相关的大型不变子空间;一旦系统进入大型不变子空间,它将在远离原点游走一段时间,然后才接近以原点为中心的单位球,此时各向同性高斯噪声能以高概率使其逃离当前所处的不变子空间,这导致了张成$\mathbb{R}^{n}$的不同不变子空间之间的瓶颈,确切地说:在大型不变子空间中启动的系统将在那里被困很长时间:该时间与不变子空间的维数呈对数线性关系,并与特征值幅度的倒数的对数成反比。在通过单条轨迹对系统转移矩阵进行普通最小二乘估计的问题中,如果与大型不变子空间相关的转移矩阵的谱是爆炸性的,且小不变子空间对应于稳定特征值,则这种现象更加明显。我们的分析为连续高维状态空间上随机动态系统的学习与集中不等式的复杂性提供了首个可解释的几何解释;向我们揭示了高维空间中的反常现象。

英文摘要:

In this work, we study non-asymptotic bounds on correlation between two time realizations of stable linear systems with isotropic Gaussian noise. Consequently, via sampling from a sub-trajectory and using \emph{Talagrands'} inequality, we show that empirical averages of reward concentrate around steady state (dynamical system mixes to when closed loop system is stable under linear feedback policy ) reward , with high-probability. As opposed to common belief of larger the spectral radius stronger the correlation between samples, \emph{large discrepancy between algebraic and geometric multiplicity of system eigenvalues leads to large invariant subspaces related to system-transition matrix}; once the system enters the large invariant subspace it will travel away from origin for a while before coming close to a unit ball centered at origin where an isotropic Gaussian noise can with high probability allow it to escape the current invariant subspace it resides in, leading to \emph{bottlenecks} between different invariant subspaces that span $\mathbb{R}^{n}$, to be precise : system initiated in a large invariant subspace will be stuck there for a long-time: log-linear in dimension of the invariant subspace and inversely to log of inverse of magnitude of the eigenvalue. In the problem of Ordinary Least Squares estimate of system transition matrix via a single trajectory, this phenomenon is even more evident if spectrum of transition matrix associated to large invariant subspace is explosive and small invariant subspaces correspond to stable eigenvalues. Our analysis provide first interpretable and geometric explanation into intricacies of learning and concentration for random dynamical systems on continuous, high dimensional state space; exposing us to surprises in high dimensions

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑