This paper rigorously connects the problem of optimal control of McKean-Vlasov dynamics with large systems of interacting controlled state processes. Precisely, the empirical distributions of near-optimal control-state pairs for the $n$-state systems, as $n$ tends to infinity, admit limit points in distribution (if the objective functions are suitably coercive), and every such limit is supported on the set of optimal control-state pairs for the McKean-Vlasov problem. Conversely, any distribution on the set of optimal control-state pairs for the McKean-Vlasov problem can be realized as a limit in this manner. Arguments are based on controlled martingale problems, which lend themselves naturally to existence proofs; along the way it is shown that a large class of McKean-Vlasov control problems admit optimal Markovian controls.
In this paper we study the sensitivity of nonlinear stochastic differential equations of McKean-Vlasov type generated by stable-like processes. By using the method of stochastic characteristics, we transfer these equations to the non-stochastic equations with random coefficients thus making it possible to use the results obtained for nonlinear PDE of McKean-Vlasov type generated by stable-like processes in the previous works. The motivation for studying sensitivity of nonlinear McKean-Vlasov SPDEs arises naturally from the analysis of the mean-field games with common noise.
The purpose of this paper is to study optimal control of conditional McKean-Vlasov (mean-field) stochastic differential equations with jumps (conditional McKean-Vlasov jump diffusions, for short). To this end, we first prove a stochastic Fokker-Planck equation for the conditional law of the solution of such equations. Combining this equation with the original state equation, we obtain a Markovian system for the state and its conditional law. Furthermore, we apply this to formulate an Hamilton-Jacobi-Bellman (HJB) equation for the optimal control of conditional McKean-Vlasov jump diffusions. Th…
We consider the stochastic optimal control problem of nonlinear mean-field systems in discrete time. We reformulate the problem into a deterministic control problem with marginal distribution as controlled state variable, and prove that dynamic programming principle holds in its general form. We apply our method for solving explicitly the mean-variance portfolio selection and the multivariate linear-quadratic McKean-Vlasov control problem.
We consider a mean field game with common noise in which the diffusion coefficients may be controlled. We prove existence of a weak relaxed solution under some continuity conditions on the coefficients. We then show that, when there is no common noise, the solution of this mean field game is characterized by a McKean-Vlasov type second order backward SDE.
We study a class of non linear integro-differential equations on the Wasserstein space related to the optimal control of McKean--Vlasov jump-diffusions. We develop an intrinsic notion of viscosity solutions that does not rely on the lifting to an Hilbert space and prove a comparison theorem for these solutions. We also show that the value function is the unique viscosity solution.
In this paper, we show existence and uniqueness of solutions of the infinite horizon McKean-Vlasov FBSDEs using two different methods, which lead to two different sets of assumptions. We use these results to solve the infinite horizon mean field type control problems and mean field games.
We study the problem of optimal stopping of conditional McKean-Vlasov (mean-field) stochastic differential equations with jumps (conditional McKean-Vlasov jump diffusions, for short). We obtain sufficient variational inequalities for a function to be the value function of such a problem and for a stopping time to be optimal. To achieve this, we combine the state equation for the conditional McKean-Vlasov equation with the associated stochastic Fokker-Planck equation for the conditional law of the solution of the state. This gives us a Markovian system which can be handled by using a version of…
We study the McKean-Vlasov optimal control problem with common noise in various formulations, namely the strong and weak formulation, as well as the Markovian and non-Markovian formulations, and allowing for the law of the control process to appear in the state dynamics. By interpreting the controls as probability measures on an appropriate canonical space with two filtrations, we then develop the classical measurable selection, conditioning and concatenation arguments in this new context, and establish the dynamic programming principle under general conditions.
We study zero-sum stochastic differential games where the state dynamics of the two players is governed by a generalized McKean-Vlasov (or mean-field) stochastic differential equation in which the distribution of both state and controls of each player appears in the drift and diffusion coefficients, as well as in the running and terminal payoff functions. We prove the dynamic programming principle (DPP) in this general setting, which also includes the control case with only one player, where it is the first time that DPP is proved for open-loop controls. We also show that the upper and lower v…
In this paper, we show the strong well-posedness of Mckean-Vlasov SDEs with non-Lipschitz coefficients. Moreover, propagation of chaos and the convergence rate for Euler's scheme of Mckean-Vlasov SDEs are also obtained.
The existence and uniqueness are established for McKean-Vlasov SDEs driven by Lévy processes. By using an approximation technique and coupling by change of measures, Harnack inequalities are investigated for McKean-Vlasov SDEs driven by subordinate Brownian motions.
In this paper, we study the stability of solutions of stochastic McKean-Vlasov equations (SMVEs) via feedback control based on discrete-time state observation. By using a specific Lyapunov function, the $H_{\infty}$ stability, asymptotic stability and exponential stability in mean square for the solution of the controlled systems are obtained. Since the distribution of solution is difficult to be observed, we study the corresponding particle system which can be observed for the feedback control. We prove that the exponential stability of control system is equivalent to the the exponential stab…
In this paper, we present sufficient conditions and criteria to establish the large and moderate deviation principle of multivalued McKean-Vlasov stochastic differential equation by means of the weak convergence method.
The work concerns a type of backward multivalued McKean-Vlasov stochastic differential equations. First, we prove the existence and uniqueness of solutions for backward multivalued McKean-Vlasov stochastic differential equations. Then, it is presented that their solutions depend continuously on the terminal values. Finally, we give a probabilistic interpretation for viscosity solutions of nonlocal quasi-linear parabolic variational inequalities.
One proves the uniqueness of distributional solutions to nonlinear Fokker--Planck equations with monotone diffusion term and derive as a consequence (restricted) uniqueness in law for the corresponding McKean--Vlasov stochastic differential equation (SDE).
We prove existence and uniqueness of physical and minimal solutions to McKean-Vlasov equations with positive feedback through elastic stopping times. We do this by establishing a relationship between this problem and a problem with absorbing stopping times. We show convergence of a particle system to the McKean-Vlasov equation. Moreover, we establish convergence of the elastic McKean-Vlasov problem to the problem with absorbing stopping times and to a reflecting Brownian motion as the elastic parameter goes to infinity or zero respectively.
We study ergodic properties of nonlinear Markov chains and stochastic McKean-Vlasov equations. For nonlinear Markov chains we obtain sufficient conditions for existence and uniqueness of an invariant measure and uniform ergodicity. We also prove optimality of these conditions. For stochastic McKean-Vlasov equations we establish exponential convergence of their solutions to stationarity in the total variation metric under Veretennikov-Khasminskii-type conditions.
Under a Lipschitz condition on distribution dependent coefficients, the central limit theorem and the moderate deviation principle are obtained for solutions of McKean-Vlasov type stochastic differential equations, which extend from the corresponding results for classical stochastic differential equations to the distribution dependent setting.
In this article, the path independent property of additive functionals of McKean-Vlasov stochastic differential equations with jumps is characterised by nonlinear partial integro-differential equations involving $L$-derivatives with respect to probability measures introduced by P.-L. Lions. Our result extends the recent work [16] by Ren and Wang where their concerned McKean-Vlasov stochastic differential equations are driven by Brownian motions.
In this paper, the well-posedness for one-dimensional path dependent McKean-Vlasov SDEs with $α$($α\geq \frac{1}{2}$)-Hölder continuous diffusion is investigated. Moreover, the associated quantitative propagation of chaos in the sense of Wasserstein distance, total variation distance as well as relative entropy is studied.
In this paper, we aim to study the asymptotic behaviour for a class of McKean-Vlasov stochastic partial differential equations with slow and fast time-scales. Using the variational approach and classical Khasminskii time discretization, we show that the slow component strongly converges to the solution of the associated averaged equation. In particular, the corresponding convergence rates are also obtained. The main results can be applied to demonstrate the averaging principle for various McKean-Vlasov nonlinear SPDEs such as stochastic porous media type equation, stochastic $p$-Laplace type e…
In this paper, we first study the well-posedness of a class of McKean-Vlasov stochastic partial differential equations driven by cylindrical $α$-stable process, where $α\in(1,2)$. Then by the method of the Khasminskii's time discretization, we prove the averaging principle of a class of multiscale McKean-Vlasov stochastic partial differential equations driven by cylindrical $α$-stable processes. Meanwhile, we obtain a specific strong convergence rate.
The purpose of this paper is to establish a stochastic differential equation for the Donsker delta measure of the solution of a McKean-Vlasov (mean-field) stochastic differential equation. If the Donsker delta measure is absolutely continuous with respect to Lebesgue measure, then its Radon-Nikodym derivative is called the Donsker delta function. In that case it can be proved that the local time of such a process is simply the integral with respect to time of the Donsker delta function. Therefore we also get an equation for the local time of such a process. For some particular McKean-Vlasov pr…
We study a large class of McKean-Vlasov SDEs with drift and diffusion coefficient depending on the density of the solution's time marginal laws in a Nemytskii-type of way. A McKean-Vlasov SDE of this kind arises from the study of the associated nonlinear FPKE, for which is known that there exists a bounded Sobolev-regular Schwartz-distributional solution u. Via the superposition principle, it is already known that there exists a weak solution to the McKean-Vlasov SDE with time marginal densities u. We show that there exists a strong solution the McKean-Vlasov SDE, which is unique among weak so…
Pathwise uniqueness for multi-dimensional stochastic McKean--Vlasov equation is established under moderate regularity conditions on the drift and diffusion coefficients. Both drift and diffusion depend on the marginal measure of the solution. For pathwise uniqueness, the drift is assumed to be Dini-continuous in the state variable, while the diffusion must be Lipschitz, continuous in time and uniformly nondegenerate. The setting is classical McKean--Vlasov, that is, coefficients of the equation are represented as integrals over the marginal distributions of the process.
The Bismut formula is established for the intrinsic derivative of singular McKean-Vlasov SDEs, where the noise coefficient belongs to a local Sobolev space, and the drift contains a locally integrable time-space term as well as a time-space-distribution term Lipschitz continuous in the space and distribution variables. The results are new also for classical SDEs.
The work concerns deviation estimates for multivalued McKean-Vlasov stochastic differential equations. First of all, we prove the large deviation principle for them by the weak convergence approach. Then the central limit theorem for them is shown with the help of a formula for $L$-derivatives. Finally, we establish the moderate deviation principle for them.
We consider conditional McKean-Vlasov stochastic differential equations (SDEs), such as the ones arising in the large-system limit of mean field games and particle systems with mean field interactions when common noise is present. The conditional time-marginals of the solutions to these SDEs satisfy non-linear stochastic partial differential equations (SPDEs) of the second order, whereas the laws of the conditional time-marginals follow Fokker-Planck equations on the space of probability measures. We prove two superposition principles: The first establishes that any solution of the SPDE can be…
The goal of this paper is to approximate several kinds of {\it Mckean-Vlasov SDEs} with {\it irregular coefficients} via weakly interacting particle systems. More precisely, propagation of chaos and convergence rate of Euler-Maruyama scheme associated with the consequent weakly interacting particle systems are investigated for Mckean-Vlasov SDEs, where (i) the diffusion terms are Hölder continuous by taking advantage of Yamada-Watanabe's approximation approach and (ii) the drifts are Hölder continuous by freezing distributions followed by invoking Zvonkin's transformation trick.
This paper is devoted to investigating the Freidlin-Wentzell's large deviation principle for a class of McKean-Vlasov quasilinear SPDEs perturbed by small multiplicative noise. We adopt the variational framework and the modified weak convergence criteria to prove the Laplace principle for McKean-Vlasov type SPDEs, which is equivalent to the large deviation principle. Moreover, we do not assume any compactness condition of embedding in the Gelfand triple to handle both the cases of bounded and unbounded domains in applications. The main results can be applied to various McKean-Vlasov type SPDEs…
We present two cubature on Wiener space algorithms for the numerical solution of McKean-Vlasov SDEs with smooth scalar interaction. The analysis hinges on sharp gradient to time-inhomogeneous parabolic PDEs bounds. These bounds may be of independent interest. They extend the classical results of Kusuoka \& Stroock. Both algorithms are tested through two numerical examples.
In this paper we study a type of stochastic McKean-Vlasov equations with non-Lipschitz coefficients. Firstly, by an Euler-Maruyama approximation existence of its weak solutions is proved. And then we observe pathwise uniqueness of its weak solutions. Finally, it is shown that the Euler-Maruyama approximation has an optimal strong convergence rate.
In this article, we develop integration by parts formulae on Wiener space for solutions of SDEs with general McKean-Vlasov interaction and uniformly elliptic coefficients. These integration by parts formulae hold both for derivatives with respect to a real variable and derivatives with respect to a measure understood in the sense of Lions. They allows us to prove the existence of a classical solution to a related PDE with irregular terminal condition. We also develop bounds for the derivatives of the density of the solutions of McKean-Vlasov SDEs.
In this paper, by utilizing Wang's Harnack inequality with power and the Banach fixed point theorem, the weak well-posedness for McKean-Vlasov SDEs with integrable drift is investigated. In addition, using the decoupled method, some regularity such as relative entropy and Sobolev's estimate of invariant probability measure are proved. Finally, by Banach's fixed theorem, the existence and uniqueness of invariant probability measure for symmetric McKean-Vlasov SDEs and stochastic Hamiltonian system with integrable drifts are obtained.
The work concerns a class of path-dependent McKean-Vlasov stochastic differential equations with unknown parameters. First, we prove the existence and uniqueness of these equations under non-Lipschitz conditions. Second, we construct maximum likelihood estimators of these parameters and then discuss their strong consistency. Third, a numerical simulation method for the class of path-dependent McKean-Vlasov stochastic differential equations is offered. Moreover, we estimate the errors between solutions of these equations and that of their numerical equations. Finally, we give an example to expl…
The work concerns invariant measures for multivalued McKean-Vlasov stochastic differential equations. First of all, we prove the exponential ergodicity of these equations. Then for a sequence of these equations, when their coefficients converge in the suitable sense, the convergence of corresponding strong solutions are presented. Finally, based on the convergence of these solutions, we establish the convergence of corresponding invariant measures.
In this paper, we consider a class of Mckean-Vlasov stochastic differential equation with oblique reflection over an non-smooth time dependent domain. We establish the existence and uniqueness results of this class, address the propagation of chaos and prove a Fredlin-Wentzell type large deviations principle (LDP). One of the main difficulties is raised by the setting of non-smooth time dependent domain. To prove the LDP, a sufficient condition for the weak convergence method, which is suitable for Mckean-Vlasov stochastic differential equation, plays an important role.
