We study a family of McKean-Vlasov (mean-field) type ergodic optimal control problems with linear control, and quadratic dependence on control of the cost function. For this class of problems we establish existence and uniqueness of an optimal control. We propose an $N$-particles Markovian optimal control problem approximating the McKean-Vlasov one and we prove the convergence in relative entropy, total variation and Wasserstein distance of the law of the former to the law of the latter when $N$ goes to infinity. Some McKean-Vlasov optimal control problems with singular cost function and the relation of these problems with the mathematical theory of Bose-Einstein condensation is also established.
We study a family of quadratic stochastic differential equations in the plane, motivated by applications to turbulent transport of heavy particles. Using Lyapunov functions, we find a critical parameter value $α_{1}=α_{2}$ such that when $α_{2}>α_{1}$ the system is ergodic and when $α_{2}<α_{1}$ solutions are not defined for all times. Hörmander's hypoellipticity theorem and geometric control theory are also utilized.
In this paper we study the stochastic quantization problem on the two dimensional torus and establish ergodicity for the solutions. Furthermore, we prove a characterization of the $Φ^4_2$ quantum field on the torus in terms of its density under translation. We also deduce that the $Φ^4_2$ quantum field on the torus is an extreme point in the set of all $L$-symmetrizing measures, where $L$ is the corresponding generator.
We study ergodic properties of stochastic dissipative systems with additive noise. We show that the system is uniformly exponentially ergodic provided the growth of nonlinearity at infinity is faster than linear. The abstract result is applied to the stochastic reaction diffusion equation in $\mathbb R^d$ with $d\le 3$.
We consider a simple model for the fluctuating hydrodynamics of a flexible polymer in dilute solution, demonstrating geometric ergodicity for a pair of particles that interact with each other through a nonlinear spring potential while being advected by a stochastic Stokes fluid velocity field. This is a generalization of previous models which have used linear spring forces as well as white-in-time fluid velocity fields. We follow previous work combining control theoretic arguments, Lyapunov functions, and hypo-elliptic diffusion theory to prove exponential convergence via a Harris chain argume…
We study ergodic properties of nonlinear Markov chains and stochastic McKean-Vlasov equations. For nonlinear Markov chains we obtain sufficient conditions for existence and uniqueness of an invariant measure and uniform ergodicity. We also prove optimality of these conditions. For stochastic McKean-Vlasov equations we establish exponential convergence of their solutions to stationarity in the total variation metric under Veretennikov-Khasminskii-type conditions.
We study ergodic quadratic optimal stochastic control problems for an affine state equation with state and control dependent noise and with stochastic coefficients. We assume stationarity of the coefficients and a finite cost condition. We first treat the stationary case and we show that the optimal cost corresponding to this ergodic control problem coincides with the one corresponding to a suitable stationary control problem and we provide a full characterization of the ergodic optimal cost and control.
We prove the convergence at an exponential rate towards the invariant probability measure for a class of solutions of stochastic differential equations with finite delay. This is done, in this non-Markovian setting, using the cluster expansion method, inspired from [4] or [14]. As a consequence, the results hold for small perturbations of ergodic diffusions.
In this paper we introduce a new kind of Backward Stochastic Differential Equations, called ergodic BSDEs, which arise naturally in the study of optimal ergodic control. We study the existence, uniqueness and regularity of solution to ergodic BSDEs. Then we apply these results to the optimal ergodic control of a Banach valued stochastic state equation. We also establish the link between the ergodic BSDEs and the associated Hamilton-Jacobi-Bellman equation. Applications are given to ergodic control of stochastic partial differential equations.
In this note, we study a large class of stochastic wave equations with spatial dimension less than or equal to $3$. Via a soft application of Malliavin calculus, we establish that their random field solutions are spatially ergodic.
We consider ergodic backward stochastic differential equations in a discrete time setting, where noise is generated by a finite state Markov chain. We show existence and uniqueness of solutions, along with a comparison theorem. To obtain this result, we use a Nummelin splitting argument to obtain ergodicity estimates for a discrete time Markov chain which hold uniformly under suitable perturbations of its transition matrix. We conclude with an application of this theory to a treatment of an ergodic control problem.
In this paper, we establish the existence and uniqueness of invariant measures for a class of semilinear stochastic partial differential equations driven by multiplicative noise on a bounded domain. The main results can be applied to SPDEs of various types such as the stochastic Burgers equation and the reaction-diffusion equations perturbed by space-time white noise.
The stochastic 2D Navier-Stokes equations on the torus driven by degenerate noise are studied. We characterize the smallest closed invariant subspace for this model and show that the dynamics restricted to that subspace is ergodic. In particular, our results yield a purely geometric characterization of a class of noises for which the equation is ergodic in $Ł^2_0(\TT^2)$. Unlike previous works, this class is independent of the viscosity and the strength of the noise. The two main tools of our analysis are the \textit{asymptotic strong Feller} property, introduced in this work, and an approxima…
We study quadratic optimal stochastic control problems with control dependent noise state equation perturbed by an affine term and with stochastic coefficients. Both infinite horizon case and ergodic case are treated. To this purpose we introduce a Backward Stochastic Riccati Equation and a dual backward stochastic equation, both considered in the whole time line. Besides some stabilizability conditions we prove existence of a solution for the two previous equations defined as limit of suitable finite horizon approximating problems. This allows to perform the synthesis of the optimal control.
In this paper we consider ergodic optimal control of a diffusion process $\{X^u_t\}_{t \geq 0}$, taking values in $\bR^n$, where both drift and volatility are controlled. We establish a novel strong duality between the existence of a unique solution to the infinite horizon adjoint BSDE and strong dissipativity of $X^u$. We then proceed to show that the latter implies irreducibility, the strong Feller property and exponential ergodicity. We conclude by discussing the connection with ergodic BSDEs.
We study the nonlinear Schrödinger equation with linear damping, i.e. a zero order dissipation, and additive noise. Working in $R^d$ with d = 2 or d = 3, we prove the uniqueness of the invariant measure when the damping coefficient is sufficiently large.
The objective of this note is to present the results from the two recent papers. We study the Navier--Stokes equation on the two--dimensional torus when forced by a finite dimensional white Gaussian noise. We give conditions under which both the law of the solution at any time t>0, projected on a finite dimensional subspace, has a smooth density with respect to Lebesgue measure and the solution itself is ergodic. In particular, our results hold for specific choices of four dimensional white Gaussian noise. Under additional assumptions, we show that the preceding density is everywhere strictly …
We study a model of the motion by mean curvature of an (1+1) dimensional interface in a 2D Brownian velocity field. For the well-posedness of the model we prove existence and uniqueness for certain degenerate nonlinear stochastic evolution equations in the variational framework of Krylov Rozovskii, replacing the standard coercivity assumption by a Lyapunov type condition. Ergodicity is established for the case of additive noise, using the lower bound technique for Markov semigroups by Komorowski, Peszat and Szarek
We establish moment estimates for the invariant measure of a stochastic partial differential equation describing motion by mean curvature flow in (1+1) dimension, leading to polynomial stability of the associated Markov semigroup. We also prove maximal dissipativity for the related Kolmogorov operator.
We show that singular stochastic delay differential equations (SDDEs) induce cocycle maps on a field of Banach spaces. A general Multiplicative Ergodic Theorem on fields of Banach spaces is proved and applied to linear SDDEs. In Part II of this article, we use our results to prove a stable manifold theorem for non-linear singular SDDEs.
We prove that diffusion equations with a space-time stationary and ergodic, divergence-free drift homogenize in law to a deterministic stochastic partial differential equation with Stratonovich transport noise. In the absence of spatial ergodicity, the drift is only partially absorbed into the skew-symmetric part of the flux through the use of an appropriately defined stream matrix. This leaves a time-dependent, spatially-homogenous transport which, for mildly decorrelating fields, converges to a Brownian noise with deterministic covariance in the homogenization limit. The results apply to uni…
We study ergodic properties of stochastic geometric wave equations on a particular model with the target being the 2D sphere while considering the space variable-independent solutions only. This simplification leads to a degenerate stochastic equation in the tangent bundle of the 2D sphere. Studying this equation, we prove existence and non-uniqueness of invariant probability measures for the original problem and we obtain also results on attractivity towards an invariant measure. We also present a suitable numerical scheme for approximating the solutions subject to a sphere constraint.
We consider a class of semi-linear differential Volterra equations with memory terms, polynomial nonlinearities and random perturbation. For a broad class of nonlinearities, we study statistically steady states of the system and find that they possess regularities compatible with those of the weak solutions. Moreover, if sufficiently many directions in the phase space are stochastically forced, we employ the \emph{generalized coupling} approach to establish the existence and uniqueness of the invariant probability measure to which the system is exponentially attractive. This extends ergodicity…
We prove the existence and uniqueness of invariant measures for the fractional stochastic Burgers equation (FSBE) driven by fractional power of the Laplacian and space-time white noise. We show also that the transition measures of the solution converge to the invariant measure in the norm of total variation. To this end we show first two results which are of independent interest: that the semigroup corresponding to the solution of the FSBE is strong Feller and irreducible.
We study the ergodic properties of finite-dimensional systems of SDEs driven by non-degenerate additive fractional Brownian motion with arbitrary Hurst parameter $H\in(0,1)$. A general framework is constructed to make precise the notions of ``invariant measure'' and ``stationary state'' for such a system. We then prove under rather weak dissipativity conditions that such an SDE possesses a unique stationary solution and that the convergence rate of an arbitrary solution towards the stationary one is (at least) algebraic. A lower bound on the exponent is also given.
We present a version of the stochastic maximum principle (SMP) for ergodic control problems. In particular we give necessary (and sufficient) conditions for optimality for controlled dissipative systems in finite dimensions. The strategy we employ is mainly built on duality techniques. We are able to construct a dual process for all positive times via the analysis of a suitable class of perturbed linearized forward equations. We show that such a process is the unique bounded solution to a Backward SDE on infinite horizon from which we can write a version of the SMP.
Ergodicity for local and nonlocal stochastic singular $p$-Laplace equations is proven, without restriction on the spatial dimension and for all $p\in[1,2)$. This generalizes previous results from [Gess, Tölle; J. Math. Pures Appl., 2014], [Liu, Tölle; Electron. Commun. Probab., 2011], [Liu; J. Evol. Equations, 2009]. In particular, the results include the multivalued case of the stochastic (nonlocal) total variation flow, which solves an open problem raised in [Barbu, Da Prato, Röckner; SIAM J. Math. Anal., 2009]. Moreover, under appropriate rescaling, the convergence of the unique invariant m…
Periodic measures are the time-periodic counterpart to invariant measures for dynamical systems and can be used to characterise the long-term periodic behaviour of stochastic systems. This paper gives sufficient conditions for the existence, uniqueness and geometric convergence of a periodic measure for time-periodic Markovian processes on a locally compact metric space in great generality. In particular, we apply these results in the context of time-periodic weakly dissipative stochastic differential equations, gradient stochastic differential equations as well as Langevin equations. We will …
We establish verifiable general sufficient conditions for exponential or subexponential ergodicity of Markov processes that may lack the strong Feller property. We apply the obtained results to show exponential ergodicity of a variety of nonlinear stochastic partial differential equations with additive forcing, including 2D stochastic Navier-Stokes equations. Our main tool is a new version of the generalized coupling method.
In this paper we study ergodic backward stochastic differential equations (EBSDEs) dropping the strong dissipativity assumption needed in the previous work. In other words we do not need to require the uniform exponential decay of the difference of two solutions of the underlying forward equation, which, on the contrary, is assumed to be non degenerate. We show existence of solutions by use of coupling estimates for a non-degenerate forward stochastic differential equations with bounded measurable non-linearity. Moreover we prove uniqueness of "Markovian" solutions exploiting the recurrence of…
Value existence for zero-sum ergodic stochastic differential games
School of Mathematics and Statistics, Shandong University（山东大学数学与统计学院）；Research Center for Mathematics and Interdisciplinary Sciences, Shandong University（山东大学数学交叉科学研究院）；Department of Mathematical Sciences, Durham University（杜伦大学数学科学系）
This paper is concerned with the following problem: Given a stochastic non-linear system controlled over a noisy channel, what is the largest class of channels for which there exist coding and control policies so that the closed loop system is stochastically stable? Stochastic stability notions considered are stationarity, ergodicity or asymptotic mean stationarity. We do not restrict the state space to be compact, for example systems considered can be driven by unbounded noise. Necessary and sufficient conditions are obtained for a large class of systems and channels. A generalization of Bode…
Motivated by studying stochastic systems with non-Gaussian Lévy noise, spectral properties for a type of linear cocycles are considered. These linear cocycles have countable jump discontinuities in time. A multiplicative ergodic theorem is proved for such linear cocycles. Then, the result is illustrated for two linear stochastic systems with general Lévy motions.
We study the global-in-time dynamics for a stochastic semilinear wave equation with cubic defocusing nonlinearity and additive noise, posed on the $2$-dimensional torus. The noise is taken to be slightly more regular than space-time white noise. In this setting, we show existence and uniqueness of an invariant measure for the Markov semigroup generated by the flow over an appropriately chosen Banach space. This extends a result of the second author to a situation where the invariant measure is not explicitly known.
Well-posedness à la Friedrichs is proved for a class of degenerate Kolmogorov equations associated to stochastic Allen-Cahn equations with logarithmic potential. The thermodynamical consistency of the model requires the potential to be singular and the multiplicative noise coefficient to vanish at the respective potential barriers, making thus the corresponding Kolmogorov equation not uniformly elliptic in space. First, existence and uniqueness of invariant measures and ergodicity are discussed. Then, classical solutions to some regularised Kolmogorov equations are explicitly constructed. Even…
In an earlier work made by the first author with J. Turi (Degenerate Dirichlet Problems Related to the Invariant Measure of Elasto-Plastic Oscillators, AMO, 2008), the solution of a stochastic variational inequality modeling an elasto-perfectly-plastic oscillator has been studied. The existence and uniqueness of an invariant measure have been proven. Nonlocal problems have been introduced in this context. In this work, we present a new characterization of the invariant measure. The key finding is the connection between nonlocal PDEs and local PDEs which can be interpreted with short cycles of …
Long-time dynamics of stochastic wave equation with dissipative damping and its full discretization: exponential ergodicity and strong law of large numbers
A successful method to describe the asymptotic behavior of various deterministic and stochastic processes such as asymptotically autonomous differential equations or stochastic approximation processes is to relate it to an appropriately chosen limit semiflow. Benaïm and Schreiber (2000) define a general class of such stochastic processes, which they call weak asymptotic pseudotrajectories and study their ergodic behavior. In particular, they prove that the weak* limit points of the empirical measures associated to such processes are almost surely invariant for the associated deterministic semi…
