We provide a very brief introduction to typical paths and the corresponding Itô type integration. Relying on this robust Itô integration, we prove an existence and uniqueness result for one-dimensional differential equations driven by typical paths with non-Lipschitz continuous coefficients in the spirit of Yamada--Watanabe as well as an approximation result in the spirit of Doss--Sussmann.
We study a two-player zero-sum stochastic differential game with both players adopting impulse controls, on a finite time horizon. The Hamilton-Jacobi-Bellman-Isaacs (HJBI) partial differential equation of the game turns out to be a double-obstacle quasi-variational inequality, therefore the two obstacles are implicitly given. We prove that the upper and lower value functions coincide, indeed we show, by means of the dynamic programming principle for the stochastic differential game, that they are the unique viscosity solution to the HJBI equation, therefore proving that the game admits a valu…
We show a method of uniform approximation of the value functions of uniformly nondegenerate stochastic differential games in smooth domains up to a constant over $K$ with the ones having second-order derivatives bounded by a constant times $K$ for any $K\geq1$
This paper is concerned with the switching game of a one-dimensional backward stochastic differential equation (BSDE). The associated Bellman-Isaacs equation is a system of matrix-valued BSDEs living in a special unbounded convex domain with reflection on the boundary along an oblique direction. In this paper, we show the existence of an adapted solution to this system of BSDEs with oblique reflection by the penalization method, the monotone convergence, and the a priori estimates.
We study a general class of fully coupled backward-forward stochastic differential equations of mean-field type (MF-BFSDE). We derive existence and uniqueness results for such a system under weak monotonicity assumptions and without the non-degeneracy condition on the forward equation. This is achieved by suggesting an implicit approximation scheme that is shown to converge to the solution of the system of MF-BFSDE. We apply these results to derive an explicit form of open-loop Nash equilibrium strategies for nonzero sum mean-field linear-quadratic stochastic differential games with random coe…
In this Note, assuming that the generator is uniform Lipschitz in the unknown variables, we relate the solution of a one dimensional backward stochastic differential equation with the value process of a stochastic differential game. Under a domination condition, a filtration-consistent evaluations is also related to a stochastic differential game. This relation comes out of a min-max representation for uniform Lipschitz functions as affine functions. The extension to reflected backward stochastic differential equations is also included.
We consider a two-player zero-sum stochastic differential game in which one of the players has a private information on the game. Both players observe each other, so that the non-informed player can try to guess his missing information. Our aim is to quantify the amount of information the informed player has to reveal in order to play optimally: to do so, we show that the value function of this zero-sum game can be rewritten as a minimization problem over some martingale measures with a payoff given by the solution of a backward stochastic differential equation.
This work establishes sufficient conditions for existence of saddle points in discrete Markov games. The result reveals the relation between dynamic games and static games using dynamic programming equations. This result enables us to prove existence of saddle points of non-separable stochastic differential games of regime-switching diffusions under appropriate conditions.
In this paper, we investigate Nash equilibrium payoffs for nonzero-sum stochastic differential games with reflection. We obtain an existence theorem and a characterization theorem of Nash equilibrium payoffs for nonzero-sum stochastic differential games with nonlinear cost functionals defined by doubly controlled reflected backward stochastic differential equations.
We study linear-quadratic stochastic differential games on directed chains inspired by the directed chain stochastic differential equations introduced by Detering, Fouque, and Ichiba. We solve explicitly for Nash equilibria with a finite number of players and we study more general finite-player games with a mixture of both directed chain interaction and mean field interaction. We investigate and compare the corresponding games in the limit when the number of players tends to infinity. The limit is characterized by Catalan functions and the dynamics under equilibrium is an infinite-dimensional …
We consider a symmetric $n$-player nonzero-sum stochastic differential game with controlled jumps and mean-field type interaction among the players. Each player minimizes some expected cost by affecting the drift as well as the jump part of their own private state process. We consider the corresponding limiting mean-field game and, under the assumption that the latter admits a regular Markovian solution, we prove that an approximate Nash equilibrium for the $n$-player game can be constructed for $n$ large enough, and provide the rate of convergence. This extends to a class of games with contro…
The theory of first-order mean field type differential games examines the systems of infinitely many identical agents interacting via some external media under assumption that each agent is controlled by two players. We study the approximations of the value function of the first-order mean field type differential game using solutions of model finite-dimensional differential games. The model game appears as a mean field type continuous time Markov game, i.e., the game theoretical problem with the infinitely many agents and dynamics of each agent determined by a controlled finite state nonlinear…
In this paper, we study Nash equilibrium payoffs for nonzero-sum stochastic differential games via the theory of backward stochastic differential equations. We obtain an existence theorem and a characterization theorem of Nash equilibrium payoffs for nonzero-sum stochastic differential games with nonlinear cost functionals defined with the help of a doubly controlled backward stochastic differential equation. Our results extend former ones by Buckdahn, Cardaliaguet and Rainer (2004) and are based on a backward stochastic differential equation approach.
This paper is related to nonzero-sum stochastic differential games in the Markovian framework. We show existence of a Nash equilibrium point for the game when the drift is no longer bounded and only satisfies a linear growth condition. The main tool is the notion of backward stochastic differential equations which, in our case, are multidimensional with continuous coefficient and stochastic linear growth.
We establish existence of nearly-optimal controls, conditions for existence of an optimal control and a saddle-point for respectively a control problem and zero-sum differential game associated with payoff functionals of mean-field type, under dynamics driven by weak solutions of stochastic differential equations of mean-field type.
The study of linear-quadratic stochastic differential games on directed networks was initiated in Feng, Fouque \& Ichiba \cite{fengFouqueIchiba2020linearquadratic}. In that work, the game on a directed chain with finite or infinite players was defined as well as the game on a deterministic directed tree, and their Nash equilibria were computed. The current work continues the analysis by first developing a random directed chain structure by assuming the interaction between every two neighbors is random. We solve explicitly for an open-loop Nash equilibrium for the system and we find that the dy…
In this paper we investigate Nash equilibrium payoffs for two-player nonzero-sum stochastic differential games whose cost functionals are defined by a system of coupled backward stochastic differential equations. We obtain an existence theorem and a characterization theorem for Nash equilibrium payoffs. For this end the problem is described equivalently by a stochastic differential game with jumps. But, however, unlike the work by Buckdahn, Hu and Li [9], here the important tool of a dynamic programming principle for stopping times has to be developed. Moreover, we prove that the lower and upp…
The mean field limit of large-population symmetric stochastic differential games is derived in a general setting, with and without common noise, on a finite time horizon. Minimal assumptions are imposed on equilibrium strategies, which may be asymmetric and based on full information. It is shown that approximate Nash equilibria in the $n$-player games admit certain weak limits as $n$ tends to infinity, and every limit is a weak solution of the mean field game (MFG). Conversely, every weak MFG solution can be obtained as the limit of a sequence of approximate Nash equilibria in the $n$-player g…
We study a differential game that governs the moderate-deviation heavy-traffic asymptotics of a multiclass single-server queueing control problem with a risk-sensitive cost. We consider a cost set on a finite but sufficiently large time horizon, and show that this formulation leads to stationary feedback policies for the game. Several aspects of the game are explored, including its characterization via a (one-dimensional) free boundary problem, the semi-explicit solution of an optimal strategy, and the specification of a saddle point. We emphasize the analogy to the well-known Harrison-Taksar …
Zero sum games with risk-sensitive cost criterion are considered with underlying dynamics being given by controlled stochastic differential equations. Under the assumption of geometric stability on the dynamics , we completely characterize all possible saddle point strategies in the class of stationary Markov controls. In addition, we also establish existence-uniqueness result for the value function of the Hamilton-Jacobi-Isaacs equation.
We develop a martingale approach for studying continuous-time stochastic differential games of control and stopping, in a non-Markovian framework and with the control affecting only the drift term of the state-process. Under appropriate conditions, we show that the game has a value and construct a saddle pair of optimal control and stopping strategies. Crucial in this construction is a characterization of saddle pairs in terms of pathwise and martingale properties of suitable quantities.
We investigate a two-player zero-sum stochastic differential game problem with the state process being constrained in a connected bounded closed domain, and the cost functional described by the solution of a generalized backward stochastic differential equation (GBSDE for short). We show that the value functions enjoy a (strong) dynamic programming principle, and are the unique viscosity solution of the associated Hamilton-Jacobi-Bellman-Isaacs equations with nonlinear Neumann boundary problems. To obtain the existence for viscosity solutions, we provide a new approach utilizing the representa…
In this paper we study the zero-sum and nonzero-sum differential games with not assuming Isaacs condition. Along with the partition $π$ of the time interval $[0,T]$, we choose the suitable random non-anticipative strategy with delay to study our differential games with asymmetric information. Using Fenchel transformation, we prove that the limits of the upper value function $W^π$ and lower value function $V^π$ coincide when the mesh of partition $π$ tends to 0. Moreover, we give a characterization for the Nash equilibrium payoff (NEP, for short) of our nonzero-sum differential games without Is…
This paper studies the mixed zero-sum stochastic differential game problem. We allow the functionals and dynamics to be of polynomial growth. The problem is formulated as an extended doubly reflected BSDEs with a specific generator. We show the existence of solution for this doubly reflected BSDEs and we prove the existence of a saddle-point of the game. Moreover, in the Markovian framework we prove that the value function is the unique viscosity solution of the associated Hamilton-Jacobi-Bellman equation.
We consider a multi-player stochastic differential game with linear McKean-Vlasov dynamics and quadratic cost functional depending on the variance and mean of the state and control actions of the players in open-loop form. Finite and infinite horizon problems with possibly some random coefficients as well as common noise are addressed. We propose a simple direct approach based on weak martingale optimality principle together with a fixed point argument in the space of controls for solving this game problem. The Nash equilibria are characterized in terms of systems of Riccati ordinary different…
The purpose of this paper is to study 2-person zero-sum stochastic differential games, in which one player is a major one and the other player is a group of $N$ minor agents which are collectively playing, statistically identical and have the same cost-functional. The game is studied in a weak formulation; this means in particular, we can study it as a game of the type "feedback control against feedback control". The payoff/cost functional is defined through a controlled backward stochastic differential equation, for which driving coefficient is assumed to satisfy strict concavity-convexity wi…
We show that the value function in a stochastic differential game does not change if we keep the same space $(Ω,\mathcal{F})$ but introduce probability measures by means of Girsanov's transformation {\em depending} on the policies of the players. We also show that the value function does not change if we allow the driving Wiener processes to depend on the policies of the players. Finally, we show that the value function does not change if we perform a random time change with the rate depending on the policies of the players.
We analyze a zero-sum stochastic differential game between two competing players who can choose unbounded controls. The payoffs of the game are defined through backward stochastic differential equations. We prove that each player's priority value satisfies a weak dynamic programming principle and thus solves the associated fully non-linear partial differential equation in the viscosity sense.
This paper considers the problem of two-player zero-sum stochastic differential game with both players adopting impulse controls in finite horizon under rather weak assumptions on the cost functions ($c$ and $χ$ not decreasing in time). We use the dynamic programming principle and viscosity solutions approach to show existence and uniqueness of a solution for the Hamilton-Jacobi-Bellman-Isaacs (HJBI) partial differential equation (PDE) of the game. We prove that the upper and lower value functions coincide.
Given a bounded $\mathcaligr{C}^2$ domain $G\subset{\mathbb{R}}^m$, functions $g\in\mathcaligr{C}(\partial G,{\mathbb{R}})$ and $h\in\mathcaligr {C}(\bar{G},{\mathbb{R}}\setminus\{0\})$, let $u$ denote the unique viscosity solution to the equation $-2Δ_{\infty}u=h$ in $G$ with boundary data $g$. We provide a representation for $u$ as the value of a two-player zero-sum stochastic differential game.
This paper is devoted to a stochastic differential game of functional forward-backward stochastic differential equation (FBSDE, for short). The associated upper and lower value functions of the stochastic differential game are defined by controlled functional backward stochastic differential equations (BSDEs, for short). Applying the Girsanov transformation method introduced by Buckdahn and Li [1], the upper and the lower value functions are shown to be deterministic. We also generalize the Hamilton-Jacobi-Bellman-Isaacs (HJBI, for short) equations to the path-dependent ones. By establishing t…
In this paper, we consider the functional Itô calculus framework to find a path-dependent version of the Hamilton-Jacobi-Bellman equation for stochastic control problems that feature dynamics and running cost that depend on the path of the control. We also prove a Dynamic Programming Principle for such problems. We apply our results to path-dependence of the delay type. We further study Stochastic Differential Games in this context.
We consider zero-sum stochastic differential games with possibly path-dependent controlled state. Unlike the previous literature, we allow for weak solutions of the state equation so that the players' controls are automatically of feedback type. Under some restrictions, needed for the a priori regularity of the upper and lower value functions of the game, we show that the game value exists when both the appropriate path-dependent Isaacs condition, and the uniqueness of viscosity solutions of the corresponding path-dependent Isaacs-HJB equation hold. We also provide a general verification argum…
The paper is concerned with a zero-sum continuous-time stochastic differential game with a dynamics controlled by a Markov process and a terminal payoff. The value function of the original game is estimated using the value function of a model game. The dynamics of the model game differs from the original one. The general result applied to differential games yields the approximation of value function of differential game by the solution of countable system of ODEs.
In this paper we study zero-sum two-player stochastic differential games with jumps with the help of theory of Backward Stochastic Differential Equations (BSDEs). We generalize the results of Fleming and Souganidis [10] and those by Biswas [3] by considering a controlled stochastic system driven by a d-dimensional Brownian motion and a Poisson random measure and by associating nonlinear cost functionals defined by controlled BSDEs. Moreover, unlike the both papers cited above we allow the admissible control processes of both players to depend on all events occurring before the beginning of the…
This paper is concerned with stochastic differential games (SDGs) defined through fully coupled forward-backward stochastic differential equations (FBSDEs) which are governed by Brownian motion and Poisson random measure. For SDGs, the upper and the lower value functions are defined by the controlled fully coupled FBSDEs with jumps. Using a new transformation introduced in [6], we prove that the upper and the lower value functions are deterministic. Then, after establishing the dynamic programming principle for the upper and the lower value functions of this SDGs, we prove that the upper and t…
We investigate a two-player zero-sum stochastic differential game in which one of the players has more information on the game than his opponent. We show how to construct numerical schemes for the value function of this game, which is given by the solution of a quasilinear partial differential equation with obstacle.
We study a two-player nonzero-sum stochastic differential game where one player controls the state variable via additive impulses while the other player can stop the game at any time. The main goal of this work is characterize Nash equilibria through a verification theorem, which identifies a new system of quasi-variational inequalities whose solution gives equilibrium payoffs with the correspondent strategies. Moreover, we apply the verification theorem to a game with a one-dimensional state variable, evolving as a scaled Brownian motion, and with linear payoff and costs for both players. Two…