This paper is concerned with a linear quadratic stochastic Stackelberg differential game with time delay. The model is general, in which the state delay and the control delay both appear in the state equation, moreover, they both enter into the diffusion term. By introducing two Pseudo-Riccati equations and a special matrix equation, the state feedback representation of the open-loop Stackelberg strategy is derived, under some assumptions. Finally, two examples are given to illustrate the applications of the theoretical results.
The paper is concerned with a zero-sum Stackelberg stochastic linear-quadratic (LQ, for short) differential game over finite horizons. Under a fairly weak condition, the Stackelberg equilibrium is explicitly obtained by first solving a forward stochastic LQ optimal control problem (SLQ problem, for short) and then a backward SLQ problem. Two Riccati equations are derived in constructing the Stackelberg equilibrium. An interesting finding is that the difference of these two Riccati equations coincides with the Riccati equation associated with the zero-sum Nash stochastic LQ differential game, w…
We consider a controlled linear-quadratic (LQ) large-population system with mixture of three types agents: major leader, minor leaders and minor followers. The Stackelberg-Nash-Cournot (SNC) approximate equilibrium is studied by a major-minor mean-field game (MFG) coupled with a leader-follower Stackelberg game. By variational method, the SNC approximate equilibrium strategy can be represented by some forward-backward-stochastic-differential-equations (FBSDEs) in the open-loop sense. And we pay great effort to give the feedback form of the open-loop strategy by some Riccati equations.
This paper is concerned with the stochastic linear quadratic Stackelberg differential game with overlapping information, where the diffusion terms contain the control and state variables. Here the term "overlapping" means that there are common part between the follower's and the leader's information, while they have no inclusion relation. Optimal controls of the follower and the leader are obtained by the stochastic maximum principle, the direct calculation of the derivative of the cost functional and stochastic filtering. A new system of Riccati equations is introduced to represent the state …
This paper is concerned with the closed-loop solvability of one kind of linear-quadratic Stackelberg stochastic differential game, where the coefficients are deterministic. The notion of the closed-loop solvability is introduced, which require to be independent of the initial state. The follower's problem is solved first, and the closed-loop optimal strategy is characterized by a Riccati equation, together with an adapted solution to a linear backward stochastic differential equation. Then the necessary conditions of the existence of the leader's nonanticipating closed-loop optimal strategy is…
This paper is concerned with a three-level stochastic linear-quadratic Stackelberg differential game with asymmetric information, in which three players participate credited as Player 1, Player 2 and Player 3. Player 3 acts as the leader of Player 2 and Player 1, Player 2 acts as the leader of Player 1 and Player 1 acts as the follower. The asymmetric information considered is: the information available to Player 1 is based on the sub-$σ$-algebra of the information available to Player 2, and the information available to Player 2 is based on the sub-$σ$-algebra of the information available to P…
This paper studies a class of dynamic Stackelberg games under open-loop information structure with constrained linear agent dynamics and quadratic utility functions. We show two important properties for this class of dynamic Stackelberg games. First, we prove that under mild conditions, the optimal control of individual agents at the solution of the Stackelberg game coincides with the solution to the team problem, where all agents cooperatively achieve the coordinator's objective. Second, we show that the the agent's control at each time step is non-increasing with respect to the coordinator's…
We discuss an open-loop backward Stackelberg differential game involving single leader and single follower. Unlike most Stackelberg game literature, the state to be controlled is characterized by a backward stochastic differential equation (BSDE) for which the terminal- instead initial-condition is specified as a priori; the decisions of leader consist of a static terminal-perturbation and a dynamic linear-quadratic control. In addition, the terminal control is subject to (convex-closed) pointwise and (affine) expectation constraints. Both constraints are arising from real applications such as…
In this paper, we investigate a new model of a linear-quadratic mean-field stochastic Stackelberg differential game with one leader and two followers, in which the leader is allowed to stop her strategy at a random time. Our overarching goal is to find the Stackelberg solution of the leader and followers for such a model. By employing the backward induction method, the state equation is divided into two-stage equations. Moreover, by using the maximum principle and the verification theorem, the Stackelberg solution is obtained for such a model.
A linear-quadratic partially observed Stackelberg stochastic differential game with multiple followers and its application to multi-agent formation control
This paper considers linear-quadratic (LQ) stochastic leader-follower Stackelberg differential games for jump-diffusion systems with random coefficients. We first solve the LQ problem of the follower using the stochastic maximum principle and obtain the state-feedback representation of the open-loop optimal solution in terms of the integro-stochastic Riccati differential equation (ISRDE), where the state-feedback type control is shown to be optimal via the completion of squares method. Next, we establish the stochastic maximum principle for the indefinite LQ stochastic optimal control problem …
Linear-quadratic mixed Stackelberg-zero-sum game for mean-field regime switching system
Shandong University of Finance and Economics（山东财经大学）；Dalian University of Technology（大连理工大学）；The Hong Kong Polytechnic University（香港理工大学）；Imperial College（帝国理工学院）
In this technical note, we consider the linear-quadratic time-inconsistent mean-field type leader-follower Stackelberg differential game with an adapted open-loop information structure. The objective functionals of the leader and the follower include conditional expectations of state and control (mean field) variables, and the cost parameters could be general nonexponential discounting depending on the initial time. As stated in the existing literature, these two general settings of the objective functionals induce time inconsistency in the optimal solutions. Given an arbitrary control of the …
This paper obtains the maximum principle for both stochastic (global) open-loop and stochastic (global) closed-loop Stackelberg differential games. For the closed-loop case, we use the theory of controlled forward-backward stochastic differential equations to derive the maximum principle for the leader's optimal strategy. In the special case of the open-loop linear quadratic Stackelberg game, we consider the follower's Hamiltonian system as the leader's state equation, derive the related stochastic Riccati equation, and show the existence and uniqueness of the solution to the Riccati equation …
This paper is concerned with a linear-quadratic partially observed Stackelberg stochastic differential game with correlated state and observation noises, where the diffusion coefficient does not contain the control variable and the control set is not necessarily convex. Both the leader and the follower have their own observation equations, and the information filtration available to the leader is contained in that to the follower. By spike variational, state decomposition and backward separation techniques, necessary and sufficient conditions of the Stackelberg equilibrium points are derived. …
This paper is concerned with a Stackelberg stochastic differential game on a finite horizon in feedback information pattern. A system of parabolic partial differential equations is obtained at the level of Hamiltonian to give the verification theorem of the feedback Stackelberg equilibrium. As an example, a linear quadratic Stackelberg stochastic differential game is investigated. Riccati equations are introduced to express the feedback Stackelberg equilibrium, analytical and numerical solutions to these Riccati equations are discussed in some special cases.
This paper considers dynamic (multi-stage) signaling games involving an encoder and a decoder who have subjective models on the cost functions. We consider both Nash (simultaneous-move) and Stackelberg (leader-follower) equilibria of dynamic signaling games under quadratic criteria. For the multi-stage scalar cheap talk, we show that the final stage equilibrium is always quantized and under further conditions the equilibria for all time stages must be quantized. In contrast, the Stackelberg equilibria are always fully revealing. In the multi-stage signaling game where the transmission of a Gau…
This paper is concerned with a Stackelberg stochastic differential game with asymmetric noisy observation, with one follower and one leader. In our model, the follower cannot observe the state process directly, but could observe a noisy observation process, while the leader can completely observe the state process. Open-loop Stackelberg equilibrium is considered. The follower first solve an stochastic optimal control problem with partial observation, the maximum principle and verification theorem are obtained. Then the leader turns to solve an optimal control problem for a conditional mean-fie…
In this paper, we consider a linear quadratic (LQ) leader-follower stochastic differential game for regime switching diffusions with mean-field interactions. One of the salient features of this paper is that conditional mean-field terms are included in the state equation and cost functionals. Based on stochastic maximum principles (SMPs), the follower's problem and the leader's problem are solved sequentially and an open-loop Stackelberg equilibrium is obtained. Further, with the help of the so-called four-step scheme, the corresponding Hamiltonian systems for the two players are decoupled and…
In this paper, the known deterministic linear-quadratic Stackelberg game is revisited, whose open-loop Stackelberg solution actually possesses the nature of time inconsistency. To handle this time inconsistency, {a two-tier game framework is introduced, where the upper-tier game works according to Stackelberg's scenario with a leader and a follower, and two lower-tier intertemporal games give the follower's and leader's equilibrium response mappings that mimic the notion of time-consistent open-loop equilibrium control in existing literature. The resulting open-loop equilibrium solution of the…
This paper is concerned with a Stackelberg game of backward stochastic differential equations (BSDEs) with partial information, where the information of the follower is a sub-$σ$-algebra of that of the leader. Necessary and sufficient conditions of the optimality for the follower and the leader are first given for the general problem, by the partial information stochastic maximum principles of BSDEs and forward-backward stochastic differential equations (FBSDEs), respectively. Then a linear-quadratic (LQ) Stackelberg game of BSDEs with partial information is investigated. The state estimate fe…
This paper is concerned with a Stackelberg game of backward stochastic differential equations (BSDEs), where the coefficients of the backward system and the cost functionals are deterministic, and the control domain is convex. Necessary and sufficient conditions of the optimality for the follower and the leader are first given for the general problem, by the stochastic maximum principles of BSDEs and forward-backward stochastic differential equations (FBSDEs), respectively. Then a linear-quadratic (LQ) Stackelberg game of BSDEs is investigated under standard assumptions. The state feedback rep…
We present a linear--quadratic Stackelberg game with a large number of followers and we also derive the mean field limit of infinitely many followers. The relation between optimization and mean-field limit is studied and conditions for consistency are established. Finally, we propose a numerical method based on the derived models and present numerical results.
We consider communications through a Gaussian noise channel between an encoder and a decoder which have subjective probabilistic models on the source distribution. Although they consider the same cost function, the induced expected costs are misaligned due to their prior mismatch, which requires a game theoretic approach. We consider two approaches: a Nash setup, with no prior commitment, and a Stackelberg solution concept, where the encoder is committed to a given announced policy apriori. We show that the Stackelberg equilibrium cost of the encoder is upper semi continuous, under the Wassers…
This paper is concerned with a Stackelberg stochastic differential game, where the systems are driven by stochastic differential equation (SDE for short), in which the control enters the randomly disturbed coefficients (drift and diffusion). The control region is postulated to be convex. By making use of the first-order adjoint equation (backward stochastic differential equation, BSDE for short), we are able to establish the Pontryagin's maximum principle for the leader's global Stackelberg solution, within adapted open-loop structure and closed-loop memoryless information one, respectively, w…
We investigate the linear quadratic Gaussian Stackelberg game under a class of nested observation information pattern. Two decision makers implement control strategies relying on different information sets: The follower uses its observation data to design its strategy, whereas the leader implements its strategy using global observation data. We show that the solution requires solving a new type of forward-backward stochastic differential equations whose drift terms contain two types of conditional expectation terms associated to the adjoint variables. We then propose a method to find the funct…
We investigate a privacy-signaling game problem in which a sender with privacy concerns observes a pair of correlated random vectors which are modeled as jointly Gaussian. The sender aims to hide one of these random vectors and convey the other one whereas the objective of the receiver is to accurately estimate both of the random vectors. We analyze these conflicting objectives in a game theoretic framework with quadratic costs where depending on the commitment conditions (of the sender), we consider Nash or Stackelberg (Bayesian persuasion) equilibria. We show that a payoff dominant Nash equi…
This paper investigates a linear quadratic mean field leader-follower team problem, where the model involves one leader and a large number of weakly-coupled interactive followers. The leader and the followers cooperate to optimize the social cost. Specifically, for any strategy provided first by the leader, the followers would like to choose a strategy to minimize social cost functional. Using variational analysis and person-by-person optimality, we construct two auxiliary control problems. By solving sequentially the auxiliary control problems with consistent mean field approximations, we can…
This paper is concerned with a linear quadratic optimal control problem of delayed backward stochastic differential equations. An explicit representation is derived for the optimal control, which is a linear feedback of the entire past history and the future state trajectory in a short period of time. This is one of the major distinctive features of the delayed backward stochastic linear quadratic optimal control problem. To obtain the optimal feedback, a new class of delayed Riccati equations is introduced and the unique solvability of their solutions are discussed in detail.
This paper studies the decentralized quadratic cheap talk and signaling game problems when an encoder and a decoder, viewed as two decision makers, have misaligned objective functions. The main contributions of this study are the extension of Crawford and Sobel's cheap talk formulation to multi-dimensional sources and to noisy channel setups. We consider both (simultaneous) Nash equilibria and (sequential) Stackelberg equilibria. We show that for arbitrary scalar sources, in the presence of misalignment, the quantized nature of all equilibrium policies holds for Nash equilibria in the sense th…
A linear quadratic (LQ) stochastic optimization problem with delay involving weakly-coupled large population is investigated in this paper. Different to classic mean field (MF) game, here agents cooperate with each other to minimize the so-called \emph{social} objective. With the aid of \emph{delayed person-by-person optimality} principle, one arrives at an auxiliary LQ delayed control problem by decentralized information. A decentralized strategy is obtained by feat of an MF type anticipated forward-backward stochastic differential delay equation (AFBSDDE) consistency condition. The discounti…
This paper investigates a hybrid stochastic differential reinsurance and investment game between one reinsurer and two insurers, including a stochastic Stackelberg differential subgame and a non-zero-sum stochastic differential subgame. The reinsurer, as the leader of the Stackelberg game, can price reinsurance premium and invest its wealth in a financial market that contains a risk-free asset and a risky asset. The two insurers, as the followers of the Stackelberg game, can purchase proportional reinsurance from the reinsurer and invest in the same financial market. The competitive relationsh…
Stochastic Optimal Linear Quadratic Regulation Control of Discrete-time Systems with Delay and Quadratic Constraints
School of Control Science and Engineering, Shandong University（山东大学控制科学与工程学院）；College of Electrical Engineering and Automation, Shandong University of Science and Technology（山东科技大学电气工程学院）
A new method for solving optimal tracking control of linear quadratic time-varying systems with multiple time delays in state and input variables and with combined constraints is presented in this paper. By using the relations of Chebyshev wavelets, we simulate the optimal tracking problem to a static optimization one. This alternative method is applied on different optimal tracking systems and simulation results demonstrate the effectiveness of the proposed method.
