证明了在标准假设下,如果随机逼近迭代保持紧,则它们以概率1收敛到它们的o. d. e。极限提示一个简单的密封性测试(因此,收敛)。此外,对锁定概率的估计,即,收敛到O.D.E.的特定吸引子的概率限制给定的迭代访问其吸引区域和样本复杂性,即,还提供了在具有规定概率的期望极限集的规定邻域内所需的步数。后者改进显着现有的结果,因为他们需要一个更弱的条件,鞅差噪声。
英文摘要:
It is shown that under standard hypotheses, if stochastic approximation iterates remain tight, they converge with probability one to what their o.d.e. limit suggests. A simple test for tightness (and therefore a.s. convergence) is provided. Further, estimates on lock-in probability, i.e., the probability of convergence to a specific attractor of the o.d.e. limit given that the iterates visit its domain of attraction, and sample complexity, i.e., the number of steps needed to be within a prescribed neighborhood of the desired limit set with a prescribed probability, are also provided. The latter improve significantly upon existing results in that they require a much weaker condition on the martingale difference noise.
We study systems of simple point processes that admit stochastic intensities. We represent these point processes as thinnings of Poisson measures and are interested in a convergence result of such systems. This result states that, if the stochastic intensities of the limit point processes are independent of the underlying Poisson measures, the convergence in distribution in Skorohod topology of the stochastic intensities implies the same convergence for the point processes.
We derive a stochastic Gronwall lemma with suprema over the paths in the upper bound of the assumed affine-linear growth assumption. This allows applications to Itô processes with coefficients which depend on earlier time points such as stochastic delay equations or Euler-type approximations of stochastic differential equations. We apply our stochastic Gronwall lemma with path-suprema to stochastic functional differential equations and prove a strong convergence rate for coefficient functions which depend on path-suprema.
In this article we establish strong convergence rates on the whole probability space for explicit full-discrete approximations of stochastic Burgers equations with multiplicative trace-class noise. The key step in our proof is to establish uniform exponential moment estimates for the numerical approximations.
It is a well-established fact in the scientific literature that Picard iterations of backward stochastic differential equations with globally Lipschitz continuous nonlinearity converge at least exponentially fast to the solution. In this paper we prove that this convergence is in fact at least square-root factorially fast. We show for one example that no higher convergence speed is possible in general. Moreover, if the nonlinearity is $z$-independent, then the convergence is even factorially fast. Thus we reveal a phase transition in the speed of convergence of Picard iterations of backward st…
We study stochastic model reduction for evolution equations in infinite dimensional Hilbert spaces, and show the convergence to the reduced equations via abstract results of Wong-Zakai type for stochastic equations driven by a scaled Ornstein-Uhlenbeck process. Both weak and strong convergence are investigated, depending on the presence of quadratic interactions between reduced variables and driving noise. Finally, we are able to apply our results to a class of equations used in climate modeling.
Rate of convergence of Euler approximations of solution to mixed stochastic differential equation involving Brownian motion and fractional Brownian motion
In this paper, we study the averaging principle for a class of stochastic differential equations driven by $α$-stable processes with slow and fast time-scales, where $α\in(1,2)$. We prove that the strong and weak convergence order are $1-1/α$ and $1$ respectively. We show, by a simple example, that $1-1/α$ is the optimal strong convergence rate.
In this paper we compare the notion of stochastic two-scale convergence in the mean (by Bourgeat, Mikelić and Wright), the notion of stochastic unfolding (recently introduced by the authors), and the quenched notion of stochastic two-scale convergence (by Zhikov and Pyatnitskii). In particular, we introduce stochastic two-scale Young measures as a tool to compare mean and quenched limits. Moreover, we discuss two examples, which can be naturally analyzed via stochastic unfolding, but which cannot be treated via quenched stochastic two-scale convergence.
The main goal of the work is to study the stochastic averaging principle for two time-scales stochastic evolution equations driven by Lévy process. The solution of reduced equation with modified coefficient is derived to approximate the slow component of original equation under suitable condition. It is shown that the slow component can strongly converge to the solution of corresponding reduced equation in L^p(p>2)-strong convergence sense.Our key and novelty is how to cope with the changes caused by Lévy process and higher order moments.
This paper investigates the convergence of density approximations for stochastic heat equation in both uniform convergence topology and total variation distance. The convergence order of the densities in uniform convergence topology is shown to be exactly $1/2$ in the nonlinear case and nearly $1$ in the linear case. This result implies that the distributions of the approximations always converge to the distribution of the origin equation in total variation distance. As far as we know, this is the first result on the convergence of density approximations to the stochastic partial differential …
In this paper, we study a class of super-linear stochastic differential delay equations with Poisson jumps (SDDEwPJs). The convergence and rate of the convergence of the truncated Euler-Maruyama numerical solutions to SDDEwPJs are investigated under the generalized Khasminskii-type condition.
Strong convergence rates for an explicit numerical approximation method for stochastic evolution equations with non-globally Lipschitz continuous nonlinearities
We propose a stochastic collocation method based on the piecewise constant interpolation on the probability space combined with a finite volume method to solve the compressible Navier-Stokes system at the nodal points. We show convergence of numerical solutions to a statistical solution of the Navier-Stokes system on condition that the numerical solutions are bounded in probability. The analysis uses the stochastic compactness method based on the Skorokhod/Jakubowski representation theorem and the criterion of convergence in probability due to Gyöngy and Krylov.
Convergence rates for the stochastic gradient descent method for non-convex objective functions
University of Oxford(牛津大学);Max Planck Institute for Mathematics in the Sciences(马克斯·普朗克数学与自然科学研究所);Universität Bielefeld(比勒费尔德大学);ETH Zurich(苏黎世联邦理工学院)