In this paper we give feedback laws for a class of parametrized infinite horizon control problems under state constraints. We provide a two-player representation assuming time dependent dynamics and Lagrangian and the set constraints merely compact. Using viability results recently investigated for infinite horizon settings in presence of state constraints, we extend some known results for the linear-quadratic regulator problem to control problems with nonlinear dynamics in the state and affine in the control. Feedback laws are obtained under suitable controllability assumptions.
We consider multi-player stopping games in continuous time. Unlike Dynkin games, in our games the payoff of each player is revealed after all the players stop. Moreover, each player can adjust her own stopping strategy by observing other players' behaviors. Assuming the continuity of the payoff functions in time, we show that there always exists an $\eps$-Nash equilibrium in pure stopping strategies for any $\eps>0$.
We study the asymptotic organization among many optimizing individuals interacting in a suitable "moderate" way. We justify this limiting game by proving that its solution provides approximate Nash equilibria for large but finite player games. This proof depends upon the derivation of a law of large numbers for the empirical processes in the limit as the number of players tends to infinity. Because it is of independent interest, we prove this result in full detail. We characterize the solutions of the limiting game via a verification argument.
This paper establishes that $N$-player stochastic games with singular controls, either of bounded velocity or of finite variation, can both be approximated by mean field games (MFGs) with singular controls of bounded velocity. More specifically, it shows i) the optimal control to an MFG with singular controls of a bounded velocity $θ$ is shown to be an $ε_N$-NE to an $N$-player game with singular controls of the bounded velocity, with $ε_N = O(\frac{1}{\sqrt{N}})$, and (ii) the optimal control to this MFG is an $(ε_N + ε_θ)$-NE to an $N$-player game with singular controls of finite variation, …
We consider a 3-player game in the normal form, in which each player has two actions. We assume that the game is symmetric and repeated infinitely many times. At each stage players make their choices knowing only the average payoffs from previous stages of all the players. A strategy of a player in the repeated game is a function defined on the convex hull of the set of payoffs. Our aim is to construct a strong Nash equilibrium in the repeated game, i.e. a strategy profile being resistant to deviations by coalitions. Constructed equilibrium strategies are safe, i.e. the non-deviating player pa…
This paper is concerned with a three-level stochastic linear-quadratic Stackelberg differential game with asymmetric information, in which three players participate credited as Player 1, Player 2 and Player 3. Player 3 acts as the leader of Player 2 and Player 1, Player 2 acts as the leader of Player 1 and Player 1 acts as the follower. The asymmetric information considered is: the information available to Player 1 is based on the sub-$σ$-algebra of the information available to Player 2, and the information available to Player 2 is based on the sub-$σ$-algebra of the information available to P…
We study a pursuit-evasion differential game with finite number of pursuers and one evader in Hilbert space with geometric constraints on the control functions of players. We solve the game by presenting explicit strategies for pursuers which guarantee their pursuit as well as an strategy for the evader which guarantees its evasion.
For a mean field game model with a major and infinite minor players, we characterize a notion of Nash equilibrium via a system of so-called master equations, namely a system of nonlinear transport equations in the space of measures. Then, for games with a finite number N of minor players and a major player, we prove that the solution of the corresponding Nash system converges to the solution of the system of master equations as N tends to infinity.
We consider a zero sum differential game with lack of observation on one side. The initial state of the system is drawn at random according to some probability $μ_0$ on $\R^N$. Player-I is informed of the initial position of state while player-II knows only $μ_0$. Moreover Player-I observes Player-II's moves while Player-II is blind and has no further information. We prove that in this game with a terminal payoff the value exists and is characterized as the unique viscosity solution of some Hamilton-Jacobi equation on a space of probability measures.
We study a discrete-time finite-horizon two-players nonzero-sum stopping game where the filtration of Player 1 is richer than the filtration of Player 2. A major difficulty which is caused by the information asymmetry is that Player 2 may not know whether Player 1 has already stopped the game or not. Furthermore, the classical backward-induction approach is not applicable in the current setup. This is because when the informed player decides not to stop, he reveals information to the uninformed player and hence the decision of the uninformed player at time $t$ may not be determined by the play…
We study a two-player, zero-sum, dynamic game with incomplete information where one of the players is more informed than his opponent. We analyze the limit value as the players play more and more frequently. The more informed player observes the realization of a Markov process (X,Y) on which the payoffs depend, while the less informed player only observes Y and his opponent's actions. We show the existence of a limit value as the time span between two consecutive stages goes to zero. This value is characterized through an auxiliary optimization problem and as the unique viscosity solution of a…
In this article, we consider mean field games between a dominating player and a group of representative agents, each of which acts similarly and also interacts with each other through a mean field term being substantially influenced by the dominating player. We first provide the general theory and discuss the necessary condition for the optimal controls and game condition by adopting adjoint equation approach. We then present a special case in the context of linear-quadratic framework, in which a necessary and sufficient condition can be asserted by stochastic maximum principle; we finally est…
This paper provides sufficient conditions for the existence of solutions for two-person zero-sum games with inf/sup-compact payoff functions and with possibly noncompact decision sets for both players. Payoff functions may be unbounded, and we do not assume any convexity/concavity-type conditions. For such games expected payoff may not exist for some pairs of strategies. The results of this paper imply several classic facts. The paper also provides sufficient conditions for the existence of a value and solutions for each player. The results of this paper are illustrated with the number guessin…
We consider a formulation of a non zero-sum n players game by an n+1 players zero-sum game. We suppose the existence of the n+1-th player in addition to n players in the main game, and virtual subsidies to the n players which is provided by the n+1-th player. Its strategic variable affects only the subsidies, and does not affect choice of strategies by the n players in the main game. His objective function is the opposite of the sum of the payoffs of the n players. We will show 1) The minimax theorem by Sion (Sion(1958)) implies the existence of Nash equilibrium in the n players non zero-sum g…
We study a two-player zero-sum game in continuous time, where the payoff-a running cost-depends on a Brownian motion. This Brownian motion is observed in real time by one of the players. The other one observes only the actions of his opponent. We prove that the game has a value and characterize it as the largest convex subsolution of a Hamilton-Jacobi equation on the space of probability measures.
We show that every two-player stochastic game with finite state and action sets and bounded, Borel-measurable, and shift-invariant payoffs, admits an $\ep$-equilibrium for all $\varepsilon>0$.
We prove that every repeated game with countably many players, finite action sets, and tail-measurable payoffs admits an $ε$-equilibrium, for every $ε> 0$.
In this paper we study continuous-time two-player zero-sum optimal switching games on a finite horizon. Using the theory of doubly reflected BSDEs with interconnected barriers, we show that this game has a value and an equilibrium in the players' switching controls.
We consider two-player non-zero-sum stopping games in discrete time. Unlike Dynkin games, in our games the payoff of each player is revealed after both players stop. Moreover, each player can adjust her own stopping strategy according to the other player's action. In the first part of the paper, we consider the game where players act simultaneously at each stage. We show that there exists a Nash equilibrium in mixed stopping strategies. In the second part, we assume that one player has to act first at each stage. In this case, we show the existence of a Nash equilibrium in pure stopping strate…
After defining a pure-action profile in a nonatomic aggregative game, where players have specific compact convex pure-action sets and nonsmooth convex cost functions, as a square-integrable function, we characterize a Wardrop equilibrium as a solution to an infinite-dimensional generalized variational inequality. We show the existence of Wardrop equilibrium and variational Wardrop equilibrium, a concept of equilibrium adapted to the presence of coupling constraints, in monotone nonatomic aggregative games. The uniqueness of (variational) Wardrop equilibrium is proved for strictly or aggregativ…
A multi-player competitive Dynkin stopping game is constructed. Each player can either exit the game for a fixed payoff, determined a priori, or stay and receive an adjusted payoff depending on the decision of other players. The single period case is shown to be "weakly unilaterally competitive". We present an explicit construction of the unique value at which Nash and optimal equilibria are attained. Multiple period generalisations are explored. The game has interpretations in economic and financial contexts, for example, as a consumption model with bounded resources. It also serves as a star…
We consider a general class of nonzero-sum $N$-player stochastic games with impulse controls, where players control the underlying dynamics with discrete interventions. We adopt a verification approach and provide sufficient conditions for the Nash equilibria (NEs) of the game. We then consider the limit situation of $N \to \infty$, that is, a suitable mean-field game (MFG) with impulse controls. We show that under appropriate technical conditions, the existence of unique NE solution to the MFG, which is an $ε$-NE approximation to the $N$-player game, with $ε=O\left(\frac{1}{\sqrt{N}}\right)$.…
We consider a partially asymmetric multi-players zero-sum game with two strategic variables. All but one players have the same payoff functions, and one player (Player $n$) does not. Two strategic variables are $t_i$'s and $s_i$'s for each player $i$. Mainly we will show the following results. 1) The equilibrium when all players choose $t_i$'s is equivalent to the equilibrium when all but one players choose $t_i$'s and Player $n$ chooses $s_n$ as their strategic variables. 2) The equilibrium when all players choose $s_i$'s is equivalent to the equilibrium when all but one players choose $s_i$'…
We study the infinite horizon discrete time N-player nonzero-sum Dynkin game ($N \geq 2$) with stopping times as strategies (or pure strategies). We prove existence of an $\varepsilon$-Nash equilibrium point for the game by presenting a constructive algorithm. One of the main features is that the payoffs of the players depend on the set of players that stop at the termination stage which is the minimal stage in which at least one player stops. The existence result is extended to the case of a nonzero-sum game with finite horizon. Finally, the algorithm is illustrated by two explicit examples i…
We consider a game in which each player must find a compromise between more daring strategies that carry a high risk for him to be eliminated, and more cautious ones that, however, reduce his final score. For two symmetric players this game was originally formulated in 1961 by Dresher, who modeled a duel between two opponents. The game has also been of interest in the description of athletic competitions. We extend here the two-player game to an arbitrary number $N$ of symmetric players. We show that there is a mixed-strategy Nash equilibrium and find its exact analytic expression, which we an…
We consider two classes of constrained finite state-action stochastic games. First, we consider a two player nonzero sum single controller constrained stochastic game with both average and discounted cost criterion. We consider the same type of constraints as in [1], i.e., player 1 has subscription based constraints and player 2, who controls the transition probabilities, has realization based constraints which can also depend on the strategies of player 1. Next, we consider a N -player nonzero sum constrained stochastic game with independent state processes where each player has average cost …
Mean-field games with absorption is a class of games, that have been introduced in Campi and Fischer (2018) and that can be viewed as natural limits of symmetric stochastic differential games with a large number of players who, interacting through a mean-field, leave the game as soon as their private states hit some given boundary. In this paper, we push the study of such games further, extending their scope along two main directions. First, we allow the state dynamics and the costs to have a very general, possibly infinite-dimensional, dependence on the (non-normalized) empirical sub-probabil…
We consider transferable utility cooperative games with infinitely many players and the core understood in the space of bounded additive set functions. We show that, if a game is bounded below, then its core is non-empty if and only if the game is balanced. This finding is a generalization of Schmeidler's (1967) original result ``On Balanced Games with Infinitely Many Players'', where the game is assumed to be non-negative. We furthermore demonstrate that, if a game is not bounded below, then its core might be empty even though the game is balanced; that is, our result is tight. We also genera…
We consider an n-player symmetric stochastic game with weak interaction between the players. Time is continuous and the horizon and the number of states are finite. We show that the value function of each of the players can be approximated by the solution of a partial differential equation called the master equation. Moreover, we analyze the fluctuations of the empirical measure of the states of the players in the game and show that it is governed by a solution to a stochastic differential equation. Finally, we prove the regularity of the master equation, which is required for the above result…
