This paper concerns continuous dependence estimates for Hamilton-Jacobi-Bellman-Isaacs operators (briefly, HJBI). For the parabolic Cauchy problem, we establish such an estimate in the whole space $[0,+\infty)\times\Rn$. Moreover, under some periodicity and ellipticity assumptions, we obtain a similar estimate for the ergodic constant associated to the HJBI operator. An interesting byproduct of the latter result will be the local uniform convergence for some classes of singular perturbation problems.
In this paper, we prove a comparison result between semicontinuous viscosity sub and supersolutions growing at most quadratically of second-order degenerate parabolic Hamilton-Jacobi-Bellman and Isaacs equations. As an application, we characterize the value function of a finite horizon stochastic control problem with unbounded controls as the unique viscosity solution of the corresponding dynamic programming equation.
The purpose of this work is to produce a regularity theory for a class of parabolic Isaacs equations. Our techniques are based on approximation methods which allow us to connect our problem with a Bellman parabolic model. An approximation regime for the coefficients, combined with a smallness condition on the source term unlocks new regularity results in Sobolev and Hölder spaces.
In this paper, we propose an approximation method to study the regularity of solutions to the Isaacs equation. This class of problems plays a paramount role in the regularity theory for fully nonlinear elliptic equations. First, it is a model-problem of a non-convex operator. In addition, the usual mechanisms to access regularity of solutions fall short in addressing these equations. We approximate an Isaacs equation by a Bellman one, and make assumptions on the latter to recover information for the former. Our techniques produce results in Sobolev and Hölder spaces; we also examine a few cons…
This paper is devoted to establish continuous dependence estimates for the ergodic problem for Bellman operators (namely, estimates of (v_1-v_2) where v_1 and v_2 solve two equations with different coefficients). We shall obtain an estimate of ||v_1-v_2||_\infty with an explicit dependence on the L^\infty-distance between the coefficients and an explicit characterization of the constants and also, under some regularity conditions, an estimate of ||v_1-v_2||_{C^2(\R^n)}. Afterwards, the former result will be crucial in the estimate of the rate of convergence for the homogenization of Bellman eq…
A new stochastic control model for the long-run environmental management of rivers is mathematically and numerically analyzed, focusing on a modern sediment replenishment problem with unique nonsmooth and nonlinear properties. Rational inattention as a novel adaptive strategy to collect information and intervene against the target system is modeled using Erlangization. The system dynamics containing the river discharge following a continuous-state branching with an immigration-type process and the controlled sediment storage dynamics lead to a nonsmooth and nonlocal infinitesimal generator. Mo…
We derive $C^{1,σ}$-estimate for the solutions of a class of non-local elliptic Bellman-Isaacs equations. These equations are fully nonlinear and are associated with infinite horizon stochastic differential game problems involving jump-diffusions. The non-locality is represented by the presence of fractional order diffusion term and we deal with the particular case of $\frac 12$-Laplacian, where the order $\frac 12$ is known as the critical order in this context. More importantly, these equations are not translation invariant and we prove that the viscosity solutions of such equations are $C^{…
This paper is concerned with the asymptotic analysis of infinite systems of weakly coupled stationary Hamilton-Jacobi-Bellman equations as the discount factor tends to zero. With a specific Hamiltonian, we show the convergence of the solution and prove the solvability of the corresponding ergodic problem.
We derive the long time asymptotic of solutions to an evolutive Hamilton-Jacobi-Bellman equation in a bounded smooth domain, in connection with ergodic problems recently studied in \cite{bcr}. Our main assumption is an appropriate degeneracy condition on the operator at the boundary. This condition is related to the characteristic boundary points for linear operators as well as to the irrelevant points for the generalized Dirichlet problem, and implies in particular that no boundary datum has to be imposed. We prove that there exists a constant $c$ such that the solutions of the evolutive prob…
The quasi-periodic homogenization for some classes of first-order Hamilton-Jaconi-Bellman equation is studied in this paper. The cell problem of the quasi-periodic homogenization satisfies the non-resonance condition, under which the corresponding deterministic system is ergodic. The almost periodic homogenization for the same classes of equations is also solved, as a limit of a sequence of quasi-periodic homogenizations. Here, the almost periodicity is in the sense of H. Bohr. This result has been cited by some authors, for example: by H. Ishii, "Almost periodic homogenization of Hamilton-Jac…
For a class of Bellman equations in bounded domains we prove that sub- and supersolutions whose growth at the boundary is suitably controlled must be constant. The ellipticity of the operator is assumed to degenerate at the boundary and a condition involving also the drift is further imposed. We apply this result to stochastic control problems, in particular to an exit problem and to the small discount limit related with ergodic control with state constraints. In this context, our condition on the behavior of the operator near the boundary ensures some invariance property of the domain for the…
We prove non-uniqueness and study the behaviour of viscosity solutions of a class of uniformly elliptic fully nonlinear equations of Hamilton-Jacobi-Bellman-Isaacs type, with quadratic growth in the gradient. The crucial a priori bound for the solutions is proved through an argument which uses a boundary growth lemma, and consequences such as boundary "half"-Harnack inequalities, which are of independent interest. Our results are new even for linear equations.
In this paper, we study fully non-linear elliptic equations in non-divergence form which can be degenerate when "the gradient is small". Typical examples are either equations involving the $m$-Laplace operator or Bellman-Isaacs equations from stochastic control problems. We establish an Alexandroff-Bakelman-Pucci estimate and we prove a Harnack inequality for viscosity solutions of such degenerate elliptic equations.
We introduce a new method for proving the nonexistence of positive supersolutions of elliptic inequalities in unbounded domains of $\mathbb{R}^n$. The simplicity and robustness of our maximum principle-based argument provides for its applicability to many elliptic inequalities and systems, including quasilinear operators such as the $p$-Laplacian, and nondivergence form fully nonlinear operators such as Bellman-Isaacs operators. Our method gives new and optimal results in terms of the nonlinear functions appearing in the inequalities, and applies to inequalities holding in the whole space as w…
In this paper we deal with the problem of existence of a smooth solution of the Hamilton-Jacobi-Bellman-Isaacs (HJBI for short) system of equations associated with nonzero-sum stochastic differential games. We consider the problem in unbounded domains either in the case of continuous generators or for discontinuous ones. In each case we show the existence of a smooth solution of the system. As a consequence, we show that the game has smooth Nash payoffs which are given by means of the solution of the HJBI system and the stochastic process which governs the dynamic of the controlled system.
We obtain estimates on the continuous dependence on the coefficient for second order non-linear degenerate Neumann type boundary value problems. Our results extend previous work of Cockburn et.al., Jakobsen-Karlsen, and Gripenberg to problems with more general boundary conditions and domains. A new feature here is that we account for the dependence on the boundary conditions. As one application of our continuous dependence results, we derive for the first time the rate of convergence for the vanishing viscosity method for such problems. We also derive new explicit continuous dependence on the …
Here, we study the large-time limit of viscosity solutions of the Cauchy problem for second-order Hamilton--Jacobi--Bellman equations with convex Hamiltonians in the torus. This large-time limit solves the corresponding stationary problem, sometimes called the ergodic problem. This problem, however, has multiple viscosity solutions and, thus, a key question is which of these solutions is selected by the limit. Here, we provide a representation for the viscosity solution to the Cauchy problem in terms of generalized holonomic measures. Then, we use this representation to characterize the large-…
The notes are an overview of part of the theory of pathwise weak solutions to two classes of scalar fully nonlinear first- and second-order degenerate parabolic partial differential equations with multiplicative rough time dependence, a special case being Brownian. These are Hamilton-Jacobi-Isaacs-Bellman and quasilinear divergence form equations including multi-dimensional scalar conservation laws. If the time dependence is `regular', the weak solutions are respectively the viscosity and entropy/kinetic solutions. The results presented here are about the wellposedness of the solutions. Some c…
We consider stochastic mean field games for which the state space is a network. In the ergodic case, they are described by a system coupling a Hamilton-Jacobi-Bellman equation and a Fokker-Planck equation, whose unknowns are the invariant measure m, a value function u, and the ergodic constant $ρ$. The function u is continuous and satisfies general Kirchhoff conditions at the vertices. The invariant measure m satisfies dual transmission conditions: in particular, m is discontinuous across the vertices in general, and the values of m on each side of the vertices satisfy special compatibility co…
We consider the homogenization of Hamilton-Jacobi equations and degenerate Bellman equations in stationary, ergodic, unbounded environments. We prove that, as the microscopic scale tends to zero, the equation averages to a deterministic Hamilton-Jacobi equation and study some properties of the effective Hamiltonian. We discover a connection between the effective Hamiltonian and an eikonal-type equation in exterior domains. In particular, we obtain a new formula for the effective Hamiltonian. To prove the results we introduce a new strategy to obtain almost sure homogenization, completing a pro…
We study the ergodic control problem for a class of jump diffusions in $\mathbb{R}^d$, which are controlled through the drift with bounded controls. The Levy measure is finite, but has no particular structure; it can be anisotropic and singular. Moreover, there is no blanket ergodicity assumption for the controlled process. Unstable behavior is `discouraged' by the running cost which satisfies a mild coercive hypothesis (i.e., is near-monotone). We first study the problem in its weak formulation as an optimization problem on the space of infinitesimal ergodic occupation measures, and derive th…
We consider stochastic differential games with $N$ players, linear-Gaussian dynamics in arbitrary state-space dimension, and long-time-average cost with quadratic running cost. Admissible controls are feedbacks for which the system is ergodic. We first study the existence of affine Nash equilibria by means of an associated system of $N$ Hamilton-Jacobi-Bellman and $N$ Kolmogorov-Fokker-Planck partial differential equations. We give necessary and sufficient conditions for the existence and uniqueness of quadratic-Gaussian solutions in terms of the solvability of suitable algebraic Riccati and S…
We prove some Liouville properties for sub- and supersolutions of fully nonlinear degenerate elliptic equations in the whole space. Our assumptions allow the coefficients of the first order terms to be large at infinity, provided they have an appropriate sign, as in Ornstein- Uhlenbeck operators. We give two applications. The first is a stabilization property for large times of solutions to fully nonlinear parabolic equations. The second is the solvability of an ergodic Hamilton-Jacobi-Bellman equation that identifies a unique critical value of the operator.
In this paper we prove global bounds on the spatial gradient of viscosity solutions to second order linear and nonlinear parabolic equations in $(0,T) \times \R^N$. Our assumptions include the case that the coefficients be both unbounded and with very mild local regularity (possibly weaker than the Dini continuity), the estimates only depending on the parabolicity constant and on the modulus of continuity of coefficients (but not on their $L^{\infty}$-norm). Our proof provides the analytic counterpart to the probabilistic proof used in Priola and Wang (J. Funct. Anal. 2006) to get this type of…
A comparison principle based on couplings of partial integro-differential operators
Delft Institute of Applied Mathematics, Delft University of Technology（代尔夫特理工大学应用数学研究所）；Center for Mathematical Economics, Bielefeld University（比勒费尔德大学经济数学中心）
In this work, we give a characterization of Lipschitz operators on spaces of $C^2(M)$ functions (also $C^{1,1}$, $C^{1,γ}$, $C^1$, $C^γ$) that obey the global comparison property-- i.e. those that preserve the global ordering of input functions at any points where their graphs may touch, often called "elliptic" operators. Here $M$ is a complete Riemannian manifold. In particular, we show that all such operators can be written as a min-max over linear operators that are a combination of drift-diffusion and integro-differential parts. In the \emph{linear} (and nonlocal) case, Courrège had charac…
Uniqueness of positive solutions to viscous Hamilton-Jacobi-Bellman (HJB) equations of the form $-Δu(x) + \frac{1}γ |D{u}(x)|^γ= f(x) - λ$, with $f$ a coercive function and $λ$ a constant, in the subquadratic case, that is, $γ\in(1,2)$, appears to be an open problem. Barles and Meireles [Comm. Partial Differential Equations 41 (2016)] show uniqueness in the case that $f(x) \approx |x|^β$ and $|D f(x)|\lessapprox |x|^{(β-1)_+}$ for some $β>0$, essentially matching earlier results of Ichihara, who considered more general Hamiltonians but with better regularity for $f$. Without enforcing this ass…
