arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1705.07613math.PRmath.APmath.OC
收藏

随机势中一维受控随机游动的非凸均匀化

Nonconvex homogenization for one-dimensional controlled random walks in random potential

Atilla Yilmaz, Ofer Zeitouni

摘要:

考虑整数集上最近邻随机游动$\{X_i\}$的有限时间随机最优控制问题。代价函数是一个随机平稳遍历有界势的路径和加上$θX_n$的指数期望。随机游走策略相对于随机势是可测量的,并且是适应的,其中它们的漂移在幅度上由参数$δ\in[0,1]$均匀地限定。在自然条件下,证明了最优代价函数的归一化对数收敛。证明是建设性的意义上,我们确定渐近最优的政策给定的参数$δ$的值,以及法律的潜力。它依赖于大偏差理论的校正,而不是基于次可加性的论点,后者似乎不起作用,除非当$δ= 0$。与此控制问题相关的Bellman方程是一个二阶Hamilton Jacobi(HJ)随机偏差分方程,其随机哈密顿量在$θ$中是非凸的,除非$δ= 0$ .证明了该方程在线性初值下齐次化为一阶HJ型确定性偏微分方程。当$δ= 0$时,有效哈密顿量是无规势中无规行走的倾斜自由能,在$θ$中是凸的.相反,当$δ= 1$时,有效哈密顿量在$θ$中是分段线性和非凸的。最后,当$δ\in (0,1)$,有效的哈密顿量表示完全的倾斜自由能的$δ=0$的情况下,其凸性/非凸性$θ$的特点是由一个简单的不等式,涉及$δ$和潜在的大小,从而标记两个定性不同的控制制度。

英文摘要:

We consider a finite horizon stochastic optimal control problem for nearest-neighbor random walk $\{X_i\}$ on the set of integers. The cost function is the expectation of exponential of the path sum of a random stationary and ergodic bounded potential plus $θX_n$. The random walk policies are measurable with respect to the random potential, and are adapted, with their drifts uniformly bounded in magnitude by a parameter $δ\in[0,1]$. Under natural conditions on the potential, we prove that the normalized logarithm of the optimal cost function converges. The proof is constructive in the sense that we identify asymptotically optimal policies given the value of the parameter $δ$, as well as the law of the potential. It relies on correctors from large deviation theory as opposed to arguments based on subadditivity which do not seem to work except when $δ= 0$. The Bellman equation associated to this control problem is a second-order Hamilton-Jacobi (HJ) stochastic partial difference equation with a separable random Hamiltonian which is nonconvex in $θ$ unless $δ= 0$. We prove that this equation homogenizes under linear initial data to a first-order HJ deterministic partial differential equation. When $δ= 0$, the effective Hamiltonian is the tilted free energy of random walk in random potential and it is convex in $θ$. In contrast, when $δ= 1$, the effective Hamiltonian is piecewise linear and nonconvex in $θ$. Finally, when $δ\in (0,1)$, the effective Hamiltonian is expressed completely in terms of the tilted free energy for the $δ=0$ case and its convexity/nonconvexity in $θ$ is characterized by a simple inequality involving $δ$ and the magnitude of the potential, thereby marking two qualitatively distinct control regimes.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑