In this paper, we consider a linear quadratic stochastic two-person nonzero-sum differential game. Open-loop and closed-loop Nash equilibria are introduced. The existence of the former is characterized by the solvability of a system of forward-backward stochastic differential equations, and that of the latter is characterized by the solvability of a system of coupled symmetric Riccati differential equations. Sometimes, open-loop Nash equilibria admit a closed-loop representation, via the solution to a system of non-symmetric Riccati equations, which is different from the outcome of the closed-loop Nash equilibria in general. However, it is found that for the case of zero-sum differential games, the Riccati equation system for the closed-loop representation of open-loop saddle points coincides with that for the closed-loop saddle points, which leads to the conclusion that the closed-loop representation of open-loop saddle points is the outcome of the corresponding closed-loop saddle point as long as both exist. In particular, for linear quadratic optimal control problem, the closed-loop representation of open-loop optimal controls coincides with the outcome of the corresponding closed-loop optimal strategy, provided both exist.
Linear complementarity programming is a generalization of linear programming which encompasses the computation of Nash equilibria for bimatrix games. While the latter problem is PPAD-complete, we show that the tropical analogue of the complementarity problem associated with Nash equilibria can be solved in polynomial time. Moreover, we prove that the Lemke--Howson algorithm carries over the tropical setting and performs a linear number of pivots in the worst case. A consequence of this result is a new class of (classical) bimatrix games for which Nash equilibria computation can be done in poly…
In this paper we consider continuity of the set of Nash equilibria and approximate Nash equilibria for parameterized games. For parameterized games with unique Nash equilibria, the continuity of this equilibrium mapping is well-known. However, when the equilibria need not be unique, there may exist discontinuities in the equilibrium mapping. The focus of this work is to summarize continuity properties for parameterized Nash equilibria and prove continuity via the approximate Nash game with uniformly continuous objective functions over potentially non-compact strategy spaces.
We propose an asynchronous block-iterative decomposition algorithm to solve Nash equilibrium problems involving a mix of nonsmooth and smooth functions acting on linear mixtures of strategies. The methodology relies heavily on monotone operator theory and in particular on warped resolvents.
This paper studies an asymptotic solvability problem for linear quadratic (LQ) mean field games with controlled diffusions and indefinite weights for the state and control in the costs. We employ a rescaling approach to derive a low dimensional Riccati ordinary differential equation (ODE) system, which characterizes a necessary and sufficient condition for asymptotic solvability. The rescaling technique is further used for performance estimates, establishing an $O(1/N)$-Nash equilibrium for the obtained decentralized strategies.
This paper shows the existence of $\mathcal{O}(\frac{1}{n^γ})$-Nash equilibria in $n$-player noncooperative sum-aggregative games in which the players' cost functions, depending only on their own action and the average of all players' actions, are lower semicontinuous in the former while $γ$-Hölder continuous in the latter. Neither the action sets nor the cost functions need to be convex. For an important class of sum-aggregative games, which includes congestion games with $γ$ equal to 1, a gradient-proximal algorithm is used to construct $\mathcal{O}(\frac{1}{n})$-Nash equilibria with at most…
For generalized Nash equilibrium problems (GNEP) with shared constraints we focus on the notion of normalized Nash equilibrium in the nonconvex setting. The property of nondegeneracy for normalized Nash equilibria is introduced. Nondegeneracy refers to GNEP-tailored versions of linear independence constraint qualification, strict complementarity and second-order regularity. Surprisingly enough, nondegeneracy of normalized Nash equilibrium does not prevent from degeneracies at the individual players' level. We show that generically all normalized Nash equilibria are nondegenerate. Moreover, non…
On Finding Local Nash Equilibria (and Only Local Nash Equilibria) in Zero-Sum Games
University of California, Berkeley(加州大学伯克利分校);Department of Electrical Engineering and Computer Science(电气工程与计算机科学系);Division of Computer Science(计算机科学部);Department of Statistics(统计学系)
Designing efficient algorithms to compute Nash equilibria poses considerable challenges in Algorithmic Game Theory and Optimization. In this work, we employ integer programming techniques to compute Nash equilibria in Integer Programming Games, a class of simultaneous and non-cooperative games where each player solves a parametrized integer program. We introduce ZERO Regrets, a general and efficient cutting plane algorithm to compute, enumerate, and select Nash equilibria. Our framework leverages the concept of equilibrium inequality, an inequality valid for any Nash equilibrium, and the assoc…
We consider the problem of approximating Nash equilibria of $N$ functions $f_1,\dots, f_N$ of $N$ variables. In particular, we deduce conditions under which systems of the form $$ \dot u_j(t)=-\nabla_{x_j}f_j(u(t)) $$ $(j=1,\dots, N)$ are well posed and in which the large time limits of their solutions $u(t)=(u_1(t),\dots, u_N(t))$ are Nash equilibria for $f_1,\dots, f_N$. To this end, we will invoke the theory of maximal monotone operators. We will also identify an application of these ideas in game theory and show how to approximate equilibria in some game theoretic problems in function spac…
Our paper concerns the computation of Nash equilibria of first-price auctions with correlated values. While there exist several equilibrium computation methods for auctions with independent values, the correlation of the bidders' values introduces significant complications that render existing methods unsatisfactory in practice. Our contribution is a step towards filling this gap: inspired by the seminal fictitious play process of Brown and Robinson, we present a learning heuristic-that we call fictitious bidding (FB)-for estimating Bayes-Nash equilibria of first-price auctions with correlated…
This note is devoted to study a class of games with a continuum of players for which Cournot-Nash equilibria can be obtained by minimisation of some cost related to Optimal Transport. In particular we focus on the case of an Optimal Transport term between unequal dimension. We also present several numerical simulations.
Large population games with interactions through controls and common noise: convergence results and equivalence between $open$--$loop$ and $closed$--$loop$ controls
Nash equilibria and Pareto optimality are two distinct concepts when dealing with multiple criteria. It is well known that the two concepts do not coincide. However, in this work we show that it is possible to characterize the set of all Nash equilibria for any non-cooperative game as the Pareto optimal solutions of a certain vector optimization problem. To accomplish this task, we increase the dimensionality of the objective function and formulate a non-convex ordering cone under which Nash equilibria are Pareto efficient. We demonstrate these results, first, for shared constraint games in wh…
We consider a large population dynamic game in discrete time. The peculiarity of the game is that players are characterized by time-evolving types, and so reasonably their actions should not anticipate the future values of their types. When interactions between players are of mean-field kind, we relate Nash equilibria for such games to an asymptotic notion of dynamic Cournot-Nash equilibria. Inspired by the works of Blanchet and Carlier for the static situation, we interpret dynamic Cournot-Nash equilibria in the light of causal optimal transport theory. Further specializing to games of potent…
Characterization and Computation of Feedback Nash Equilibria in Scalar Discounted N-Player Linear Quadratic Games
IMT School for Advanced Studies Lucca(卢卡高等研究院);Research Unit DYSCO (Dynamical Systems, Control, and Optimization) at IMT School for Advanced Studies Lucca(卢卡高等研究院动态系统、控制与优化研究单元)
A fundamental open problem in monotone game theory is the computation of a specific generalized Nash equilibrium (GNE) among all the available ones, e.g. the optimal equilibrium with respect to a system-level objective. The existing GNE seeking algorithms have in fact convergence guarantees toward an arbitrary, possibly inefficient, equilibrium. In this paper, we solve this open problem by leveraging results from fixed-point selection theory and in turn derive distributed algorithms for the computation of an optimal GNE in monotone games. We then extend the technical results to the time-varyin…