This paper studies linear quadratic graphon mean field games (LQ-GMFGs) with common noise, in which a large number of agents are coupled via a weighted undirected graph. One special feature, compared with the well-studied graphon mean field games, is that the states of agents are described by the dynamic systems with the idiosyncratic noises and common noise. The limit LQ-GMFGs with common noise are formulated based on the assumption that these graphs lie in a sequence converging to a limit graphon. By applying the spectral decomposition method, the existence of solution for the formulated limit LQ-GMFGs is derived. Moreover, based on the adequate convergence assumptions, a set of $ε$-Nash equilibrium strategies for the finite large population problem is constructed.
The emergence of the graphon theory of large networks and their infinite limits has enabled the formulation of a theory of the centralized control of dynamical systems distributed on asymptotically infinite networks (Gao and Caines, IEEE CDC 2017, 2018). Furthermore, the study of the decentralized control of such systems was initiated in (Caines and Huang, IEEE CDC 2018, 2019), where Graphon Mean Field Games (GMFG) and the GMFG equations were formulated for the analysis of non-cooperative dynamic games on unbounded networks. In that work, existence and uniqueness results were introduced for th…
We consider a game for a continuum of non-identical players evolving on a finite state space. Their heterogeneous interactions are represented by a graphon, which can be viewed as the limit of a dense random graph. The player's transition rates between the states depend on their own control and the interaction strengths with the other players. We develop a rigorous mathematical framework for this game and analyze Nash equilibria. We provide a sufficient condition for a Nash equilibrium and prove existence of solutions to a continuum of fully coupled forward-backward ordinary differential equat…
We consider static finite-player network games and their continuum analogs, graphon games. Existence and uniqueness results are provided, as well as convergence of the finite-player network game optimal strategy profiles to their analogs for the graphon games. We also show that equilibrium strategy profiles of a graphon game provide approximate Nash equilibria for the finite-player games. Connections with mean field games and central planner optimization problems are discussed. Motivating applications are presented and explicit computations of their Nash equilibria and social optimal strategie…
In this paper we study the linear quadratic regulation (LQR) problem for dynamical systems coupled over large-scale networks and obtain locally computable low-complexity solutions. The underlying large or even infinite networks are represented by graphons and the couplings appear in both the dynamics and the quadratic cost. The optimal solution is obtained first for graphon dynamical systems for the special case where the graphons are exactly characterized by finite spectral summands. The complexity of generating these control solutions involves solving d+1 scalar Riccati equations where d is …
Extended Graphon Mean-Field Games in Discrete Time
University of Florida（佛罗里达大学）；The Chinese University of Hong Kong (Shenzhen)（香港中文大学（深圳））；University of Illinois at Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）；NYU Shanghai（纽约大学上海分校）；INRIA Paris（巴黎国家信息与自动化研究所）
This paper studies stochastic games on large graphs and their graphon limits. We propose a new formulation of graphon games based on a single typical player's label-state distribution. In contrast, other recently proposed models of graphon games work directly with a continuum of players, which involves serious measure-theoretic technicalities. In fact, by viewing the label as a component of the state process, we show in our formulation that graphon games are a special case of mean field games, albeit with certain inevitable degeneracies and discontinuities that make most existing results on me…
This paper establishes unique solvability of a class of Graphon Mean Field Game equations. The special case of a constant graphon yields the result for the Mean Field Game equations.
This paper studies approximate solutions to large-scale linear quadratic stochastic games with homogeneous nodal dynamics parameters and heterogeneous network couplings within the graphon mean field game framework in [2]-[4]. A graphon time-varying dynamical system model is first formulated to study the finite and then limit problems of linear quadratic Gaussian graphon mean field games (LQG-GMFG). The Nash equilibrium of the limit problem is then characterized by two coupled graphon time-varying dynamical systems. Sufficient conditions are established for the existence of a unique solution to…
In this paper, we study graphon mean field games using a system of forward-backward stochastic differential equations. We establish the existence and uniqueness of solutions under two different assumptions and prove the stability with respect to the interacting graphons which are necessary to show propagation of chaos results. As an application of propagation of chaos, we prove the convergence of n-player game Nash equilibrium for a general model, which is new in the theory of graphon mean field games.
Recent advances at the intersection of dense large graph limits and mean field games have begun to enable the scalable analysis of a broad class of dynamical sequential games with large numbers of agents. So far, results have been largely limited to graphon mean field systems with continuous-time diffusive or jump dynamics, typically without control and with little focus on computational methods. We propose a novel discrete-time formulation for graphon mean field games as the limit of non-linear dense graph Markov games with weak interaction. On the theoretical side, we give extensive and rigo…
To achieve control objectives for extremely large-scale complex networks using standard methods is essentially intractable. In this work a theory of the approximate control of complex network systems is proposed and developed by the use of graphon theory and the theory of infinite dimensional systems. First, graphon dynamical system models are formulated in an appropriate infinite dimensional space in order to represent arbitrary-size networks of linear dynamical systems, and to define the convergence of sequences of network systems with limits in the space. Exact controllability and approxima…
A Deep Learning Method for Optimal Investment Under Relative Performance Criteria Among Heterogeneous Agents
Shanghai Frontiers Science Center of Artificial Intelligence and Deep Learning（上海人工智能与深度学习前沿科学中心）；NYU-ECNU Institute of Mathematical Sciences（纽约大学-华东师范大学数学科学研究所）；NYU Shanghai（上海纽约大学）；Princeton University（普林斯顿大学）
We consider network games where a large number of agents interact according to a network sampled from a random network model, represented by a graphon. By exploiting previous results on convergence of such large network games to graphon games, we examine a procedure for estimating unknown payoff parameters, from observations of equilibrium actions, without the need for exact network information. We prove smoothness and local convexity of the optimization problem involved in computing the proposed estimator. Additionally, under a notion of graphon parameter identifiability, we show that the opt…
This paper studies an asymptotic solvability problem for linear quadratic (LQ) mean field games with controlled diffusions and indefinite weights for the state and control in the costs. We employ a rescaling approach to derive a low dimensional Riccati ordinary differential equation (ODE) system, which characterizes a necessary and sufficient condition for asymptotic solvability. The rescaling technique is further used for performance estimates, establishing an $O(1/N)$-Nash equilibrium for the obtained decentralized strategies.
This paper focuses on linear-quadratic (LQ for short) mean-field games described by forward-backward stochastic differential equations (FBSDEs for short), in which the individual control region is postulated to be convex. The decentralized strategies and consistency condition are represented by a kind of coupled mean-field FBSDEs with projection operators. The well-posedness of consistency condition system is obtained using the monotonicity condition method. The $ε$-Nash equilibrium property is discussed as well.
We consider a controlled linear-quadratic (LQ) large-population system with mixture of three types agents: major leader, minor leaders and minor followers. The Stackelberg-Nash-Cournot (SNC) approximate equilibrium is studied by a major-minor mean-field game (MFG) coupled with a leader-follower Stackelberg game. By variational method, the SNC approximate equilibrium strategy can be represented by some forward-backward-stochastic-differential-equations (FBSDEs) in the open-loop sense. And we pay great effort to give the feedback form of the open-loop strategy by some Riccati equations.
This paper is concerned with a linear quadratic stochastic Stackelberg differential game with time delay. The model is general, in which the state delay and the control delay both appear in the state equation, moreover, they both enter into the diffusion term. By introducing two Pseudo-Riccati equations and a special matrix equation, the state feedback representation of the open-loop Stackelberg strategy is derived, under some assumptions. Finally, two examples are given to illustrate the applications of the theoretical results.
Mean field games with a major player were introduced in (Huang, 2010) within a linear-quadratic (LQ) modeling framework. Due to the rich structure of major-minor player models, the past ten years have seen significant research efforts for different solution notions and analytical techniques. For LQ models, we address the relation between three solution frameworks: the Nash certainty equivalence (NCE) approach in (Huang, 2010), master equations, and asymptotic solvability, which have been developed starting with different ideas. We establish their equivalence relationships.
This paper investigates the so-called asymptotic solvability problem in linear quadratic (LQ) mean field games. The model has asymptotic solvability if for all sufficiently large population sizes, the corresponding game has a set of feedback Nash strategies subject to a mild regularity requirement. We provide a necessary and sufficient condition and show that in this case the solution converges to a mean field limit. This is accomplished by developing a re-scaling method to derive a low dimensional ordinary differential equation (ODE) system, where a non-symmetric Riccati ODE has a central rol…
The paper is concerned with a zero-sum Stackelberg stochastic linear-quadratic (LQ, for short) differential game over finite horizons. Under a fairly weak condition, the Stackelberg equilibrium is explicitly obtained by first solving a forward stochastic LQ optimal control problem (SLQ problem, for short) and then a backward SLQ problem. Two Riccati equations are derived in constructing the Stackelberg equilibrium. An interesting finding is that the difference of these two Riccati equations coincides with the Riccati equation associated with the zero-sum Nash stochastic LQ differential game, w…
This paper revisits well-studied dynamic decisions of weakly coupled large-population (LP) systems. Specifically, three types of LP decision problems: mean-field game (MG), mean-field team (MT), and mean-field-type control (MC), are completely analyzed in a general stochastic linear-quadratic setting with controlled-diffusion in state dynamics and indefinite weight in cost functional. More importantly, interrelations among MG, MT and MC are systematically discussed; some relevant interesting findings are reported that may be applied to a structural analysis of general LP decisions.
The paper is concerned with two-person zero-sum mean-field linear-quadratic stochastic differential games over finite horizons. By a Hilbert space method, a necessary condition and a sufficient condition are derived for the existence of an open-loop saddle point. It is shown that under the sufficient condition, the associated two Riccati equations admit unique strongly regular solutions, in terms of which the open-loop saddle point can be represented as a linear feedback of the current state. When the game only satisfies the necessary condition, an approximate sequence is constructed by solvin…
We investigate a class of zero-sum linear-quadratic stochastic differential games on a finite time horizon governed by multiscale state equations. The multiscale nature of the problem can be leveraged to reformulate the associated generalised Riccati equation as a deterministic singular perturbation problem. In doing so, we show that, for small enough $ε$, the existence of solution to the associated generalised Riccati equation is guaranteed by the existence of a solution to a decoupled pair of differential and algebraic Riccati equations with a reduced order of dimensionality. Furthermore, we…
