This paper focuses on linear-quadratic (LQ for short) mean-field games described by forward-backward stochastic differential equations (FBSDEs for short), in which the individual control region is postulated to be convex. The decentralized strategies and consistency condition are represented by a kind of coupled mean-field FBSDEs with projection operators. The well-posedness of consistency condition system is obtained using the monotonicity condition method. The $ε$-Nash equilibrium property is discussed as well.
Mertens, Neyman and Rosenberg [MOR, 2009] used the Mertens and Neyman theorem [IJGT, 1981] to prove the existence of uniform value for absorbing games with finite state space and compact action sets. We provide an analogous proof for another class of stochastic games, recursive games with finite state space and compact action sets. Moreover, both players have stationary epsilon-optimal strategies.
We show that a real-valued function on a topological vector space is positively homogeneous of degree one and nonexpansive with respect to a weak Minkowski norm if and only if it can be written as a minimax of linear forms that are nonexpansive with respect to the same norm. We derive a representation of monotone, additively and positively homogeneous functions on $L^\infty$ spaces and on $\mathbb{R}^n$, which extend results of Kolokoltsov, Rubinov, Singer, and others. We apply this representation to nonconvex risk measures and to zero-sum games. We derive in particular results of representati…
A uniform sunspot epsilon-equilibrium of a dynamic game is a uniform epsilon-equilibrium in an extended game, where the players observe a public signal at every stage. We prove that a uniform sunspot epsilon-equilibrium exists in two classes of multiplayer absorbing games, thereby extending earlier works by Solan and Solan (2019, 2018).
We study a discrete-time finite-horizon two-players nonzero-sum stopping game where the filtration of Player 1 is richer than the filtration of Player 2. A major difficulty which is caused by the information asymmetry is that Player 2 may not know whether Player 1 has already stopped the game or not. Furthermore, the classical backward-induction approach is not applicable in the current setup. This is because when the informed player decides not to stop, he reveals information to the uninformed player and hence the decision of the uninformed player at time $t$ may not be determined by the play…
We study two-player zero-sum recursive games with a countable state space and finite action spaces at each state. When the family of $n$-stage values $\{v_n,n\geq 1\}$ is totally bounded for the uniform norm, we prove the existence of the uniform value. Together with a result in Rosenberg and Vieille (2000), we obtain a uniform Tauberian theorem for recursive games: $(v_n)$ converges uniformly if and only if $(v_λ)$ converges uniformly. We apply our main result to finite recursive games with signals (where players observe only signals on the state and on past actions). When the maximizer is mo…
We study a type of generalized recursive game introduced by Castronova, Chen, and Zumbrun featuring increasing stakes, with an emphasis on continuous guts poker and $1$ v. $n$ coalitions. Our main results are to develop practical numerical algorithms with rigorous underlying theory for the approximation of optimal mutiplayer strategies, and to use these to obtain a number of interesting observations about guts. Outcomes are a striking 2-strategy optimum for $n$-player coalitions, with asymptotic advantage approximately $16\%$; convergence of Fictitious Play to symmetric Nash equilibrium; and a…
We study a general linear quadratic mean field type control problem and connect it to mean field games of a similar type. The solution is given both in terms of a forward/backward system of stochastic differential equations and by a pair of Riccati equations. In certain cases, the solution to the mean field type control is also the equilibrium strategy for a class of mean field games. We use this fact to study an economic model of production of exhaustible resources. Keywords: mean field type control, mean field games, linear-quadratic, optimal control, riccati equations, exhaustible resource …
This paper studies an asymptotic solvability problem for linear quadratic (LQ) mean field games with controlled diffusions and indefinite weights for the state and control in the costs. We employ a rescaling approach to derive a low dimensional Riccati ordinary differential equation (ODE) system, which characterizes a necessary and sufficient condition for asymptotic solvability. The rescaling technique is further used for performance estimates, establishing an $O(1/N)$-Nash equilibrium for the obtained decentralized strategies.
We consider a controlled linear-quadratic (LQ) large-population system with mixture of three types agents: major leader, minor leaders and minor followers. The Stackelberg-Nash-Cournot (SNC) approximate equilibrium is studied by a major-minor mean-field game (MFG) coupled with a leader-follower Stackelberg game. By variational method, the SNC approximate equilibrium strategy can be represented by some forward-backward-stochastic-differential-equations (FBSDEs) in the open-loop sense. And we pay great effort to give the feedback form of the open-loop strategy by some Riccati equations.
Continuous-Time Heterogeneous Agent Models with Recursive Utility and Preference for Late Resolution
Université de Paris Cité and Sorbonne Université, CNRS, Laboratoire Jacques-Louis Lions（巴黎西岱大学与索邦大学，法国国家科学研究中心，雅克-路易·利翁斯实验室）；School of Mathematics and Physics, China University of Geosciences (Wuhan)（中国地质大学（武汉）数学与物理学院）
This paper is concerned with a linear quadratic stochastic Stackelberg differential game with time delay. The model is general, in which the state delay and the control delay both appear in the state equation, moreover, they both enter into the diffusion term. By introducing two Pseudo-Riccati equations and a special matrix equation, the state feedback representation of the open-loop Stackelberg strategy is derived, under some assumptions. Finally, two examples are given to illustrate the applications of the theoretical results.
This paper is concerned with a linear quadratic stochastic two-person zero-sum differential game with constant coefficients in an infinite time horizon. Open-loop and closed-loop saddle points are introduced. The existence of closed-loop saddle points is characterized by the solvability of an algebraic Riccati equation with a certain stabilizing condition. A crucial result makes our approach work is the unique solvability of a class of linear backward stochastic differential equations in an infinite horizon.
Mean field games with a major player were introduced in (Huang, 2010) within a linear-quadratic (LQ) modeling framework. Due to the rich structure of major-minor player models, the past ten years have seen significant research efforts for different solution notions and analytical techniques. For LQ models, we address the relation between three solution frameworks: the Nash certainty equivalence (NCE) approach in (Huang, 2010), master equations, and asymptotic solvability, which have been developed starting with different ideas. We establish their equivalence relationships.
This paper focuses on a kind of linear quadratic non-zero sum differential game driven by backward stochastic differential equation with asymmetric information, which is a natural continuation of Wang and Yu [IEEE TAC (2010) 55: 1742-1747, Automatica (2012) 48: 342-352]. Different from Wang and Yu [IEEE TAC (2010) 55: 1742-1747, Automatica (2012) 48: 342-352], novel motivations for studying this kind of game are provided. Some feedback Nash equilibrium points are uniquely obtained by forward-backward stochastic differential equations, their filters and the corresponding Riccati equations with …
This paper investigates the so-called asymptotic solvability problem in linear quadratic (LQ) mean field games. The model has asymptotic solvability if for all sufficiently large population sizes, the corresponding game has a set of feedback Nash strategies subject to a mild regularity requirement. We provide a necessary and sufficient condition and show that in this case the solution converges to a mean field limit. This is accomplished by developing a re-scaling method to derive a low dimensional ordinary differential equation (ODE) system, where a non-symmetric Riccati ODE has a central rol…
The paper is concerned with a zero-sum Stackelberg stochastic linear-quadratic (LQ, for short) differential game over finite horizons. Under a fairly weak condition, the Stackelberg equilibrium is explicitly obtained by first solving a forward stochastic LQ optimal control problem (SLQ problem, for short) and then a backward SLQ problem. Two Riccati equations are derived in constructing the Stackelberg equilibrium. An interesting finding is that the difference of these two Riccati equations coincides with the Riccati equation associated with the zero-sum Nash stochastic LQ differential game, w…
This paper revisits well-studied dynamic decisions of weakly coupled large-population (LP) systems. Specifically, three types of LP decision problems: mean-field game (MG), mean-field team (MT), and mean-field-type control (MC), are completely analyzed in a general stochastic linear-quadratic setting with controlled-diffusion in state dynamics and indefinite weight in cost functional. More importantly, interrelations among MG, MT and MC are systematically discussed; some relevant interesting findings are reported that may be applied to a structural analysis of general LP decisions.
The paper is concerned with two-person zero-sum mean-field linear-quadratic stochastic differential games over finite horizons. By a Hilbert space method, a necessary condition and a sufficient condition are derived for the existence of an open-loop saddle point. It is shown that under the sufficient condition, the associated two Riccati equations admit unique strongly regular solutions, in terms of which the open-loop saddle point can be represented as a linear feedback of the current state. When the game only satisfies the necessary condition, an approximate sequence is constructed by solvin…
This article is dedicated to the study of mixed zero-sum two-player stochastic differential games in the situation when the player's cost functionals are modeled by doubly controlled reflected backward stochastic equations with two barriers whose coefficients have quadratic growth in Z. This is a generalization of the risk-sensitive payoffs. We show that the lower and the upper value function associated with this stochastic differential game with reflection are deterministic and they are also the unique viscosity solutions for two Isaacs equations with obstacles.
We investigate a class of zero-sum linear-quadratic stochastic differential games on a finite time horizon governed by multiscale state equations. The multiscale nature of the problem can be leveraged to reformulate the associated generalised Riccati equation as a deterministic singular perturbation problem. In doing so, we show that, for small enough $ε$, the existence of solution to the associated generalised Riccati equation is guaranteed by the existence of a solution to a decoupled pair of differential and algebraic Riccati equations with a reduced order of dimensionality. Furthermore, we…
This paper considers a class of mean field linear-quadratic-Gaussian (LQG) games with model uncertainty. The drift term in the dynamics of the agents contains a common unknown function. We take a robust optimization approach where a representative agent in the limiting model views the drift uncertainty as an adversarial player. By including the mean field dynamics in an augmented state space, we solve two optimal control problems sequentially, which combined with consistent mean field approximations provides a solution to the robust game. A set of decentralized control strategies is derived by…
In this paper, we study a time-inconsistent stochastic optimal control problem with a recursive cost functional by a multi-person hierarchical differential game approach. An equilibrium strategy of this problem is constructed and a corresponding equilibrium Hamilton-Jacobi-Bellman (HJB, for short) equation is established to characterize the associated equilibrium value function. Moreover, a well-posedness result of the equilibrium HJB equation is established under certain conditions.
This paper is concerned with the closed-loop solvability of one kind of linear-quadratic Stackelberg stochastic differential game, where the coefficients are deterministic. The notion of the closed-loop solvability is introduced, which require to be independent of the initial state. The follower's problem is solved first, and the closed-loop optimal strategy is characterized by a Riccati equation, together with an adapted solution to a linear backward stochastic differential equation. Then the necessary conditions of the existence of the leader's nonanticipating closed-loop optimal strategy is…
We consider a class of linear-quadratic-Gaussian mean-field games with a major agent and considerable heterogeneous minor agents in the presence of mean-field interactions. The individual admissible controls are constrained in closed convex subsets $Γ_{k}$ of $\mathbb{R}^{m}.$ The decentralized strategies for individual agents and consistency condition system are represented in an unified manner through a class of mean-field forward-backward stochastic differential equations involving projection operators on $Γ_{k}$. The well-posedness of consistency system is established in both the local and…
Game theory is playing more and more important roles in understanding complex systems and in investigating intelligent machines with various uncertainties. As a starting point, we consider the classical two-player zero-sum linear-quadratic stochastic differential games, but in contrast to most of the existing studies, the coefficient matrices of the systems are assumed to be unknown to both players, and consequently it is necessary to study adaptive strategies of the players, which may be termed as adaptive games and which has rarely been explored in the literature. In this paper, it will be s…
In this paper, we consider a linear quadratic (LQ) leader-follower stochastic differential game for regime switching diffusions with mean-field interactions. One of the salient features of this paper is that conditional mean-field terms are included in the state equation and cost functionals. Based on stochastic maximum principles (SMPs), the follower's problem and the leader's problem are solved sequentially and an open-loop Stackelberg equilibrium is obtained. Further, with the help of the so-called four-step scheme, the corresponding Hamiltonian systems for the two players are decoupled and…
This paper is concerned with the stochastic linear quadratic Stackelberg differential game with overlapping information, where the diffusion terms contain the control and state variables. Here the term "overlapping" means that there are common part between the follower's and the leader's information, while they have no inclusion relation. Optimal controls of the follower and the leader are obtained by the stochastic maximum principle, the direct calculation of the derivative of the cost functional and stochastic filtering. A new system of Riccati equations is introduced to represent the state …
All-Against-One (AAO) games are a special class of multi-player games where all players except one are in direct conflict with the remaining player. In the case of Linear Quadratic Differential (LQD) games, the AAO structure can be used to describe a situation where all players except one are trying to regulate the state of the system (drive it towards the origin) while the opposing player is trying to de-regulate the state (drive it away from the origin). Similar to the standard LQD games, the closed-loop Nash strategies in the AAO LQD games are expressed in terms of the solutions of a set of…
We formulate and analyze game-theoretic problems for systems governed by integral equations. For Volterra integral equations, we obtain and prove necessary and sufficient conditions for linear-quadratic problems, and for problems that are linear-quadratic in the control. Also, we obtain necessary conditions for one type of pursuit-evasion Volterra games.
This paper is concerned with a three-level stochastic linear-quadratic Stackelberg differential game with asymmetric information, in which three players participate credited as Player 1, Player 2 and Player 3. Player 3 acts as the leader of Player 2 and Player 1, Player 2 acts as the leader of Player 1 and Player 1 acts as the follower. The asymmetric information considered is: the information available to Player 1 is based on the sub-$σ$-algebra of the information available to Player 2, and the information available to Player 2 is based on the sub-$σ$-algebra of the information available to P…
In this paper we present a dual active-set solver for quadratic programming which has properties suitable for use in embedded model predictive control applications. In particular, the solver is efficient, can easily be warm-started, and is simple to code. Moreover, the exact worst-case computational complexity of the solver can be determined offline and, by using outer proximal-point iterations, ill-conditioned problems can be handled in a robust manner.
In this paper, we consider a linear quadratic stochastic two-person zero-sum differential game. The controls for both players are allowed to appear in both drift and diffusion of the state equation. The weighting matrices in the performance functional are not assumed to be definite/non-singular. A necessary and sufficient condition for the existence of a closed-loop saddle point is established in terms of the solvability of a Riccati differential equation with certain regularity. It is possible that the closed-loop saddle point fails to exist, and at the same time, the corresponding Riccati eq…
