The purpose of this paper is to explore the necessary conditions for optimality of mean-field forward-backward delay control systems. A new estimate is proved, which is a powerfultool to deal with the optimal control problems of mean-field type with delay. Different from the classical situation, in our case the first-order adjoint system is an anticipated mean-field backward stochastic differential equation, and the second-order adjoint system is a system of matrix-valued process, not mean-field type.With the help of two adjoint systems, the second-order expansion of the variation of the state $Y$ is proved, and therewith the Peng's stochastic maximum principle. As an illustrative example, we apply our result to the mean-field game in Finance. Although we just investigate the case of one pointwise delay for convenience, but our method is adequate for analysing the case of pointwise delay.
In this article, we concern a kind of partially observed non-zero sum stochastic differential game based on forward and backward stochastic differential equations (FBSDEs). It is required that each player has his own observation equation, and the corresponding open-loop Nash equilibrium control is required to adapted to the filtration that the observation process generated. To find this open-loop Nash equilibrium point, we prove the maximum principle as a necessary condition of the existence of this point, and give a verification theorem as a sufficient condition to verify it is the real open-…
We study methods for solving stochastic control problems of systems of forward-backward mean-field equations with delay, in finite or infinite horizon. Necessary and sufficient maximum principles under partial information are given. The results are applied to solve a recursive utility optimal problem
We consider a problem of optimal control of an infinite horizon system governed by forward-backward stochastic differential equations with delay. Sufficient and necessary maximum principles for optimal control under partial information in infinite horizon are derived. We illustrate our results by an application to a problem of optimal consumption with respect to recursive utility from a cash flow with delay.
This paper is concerned with a linear quadratic optimal control problem of delayed backward stochastic differential equations. An explicit representation is derived for the optimal control, which is a linear feedback of the entire past history and the future state trajectory in a short period of time. This is one of the major distinctive features of the delayed backward stochastic linear quadratic optimal control problem. To obtain the optimal feedback, a new class of delayed Riccati equations is introduced and the unique solvability of their solutions are discussed in detail.
This paper is concerned with the decoupling of delayed linear forward-backward stochastic differential equations (D-FBSDEs), which is much more involved than the delay-free case due to the infinite dimension caused by the delay. A new approach of `discretization' is proposed to obtain the explicit solution to the D-FBSDEs. Firstly, we transform the continuous-time D-FBSDEs into the discrete-time form by using discretization. Secondly, we derive the solution of the discrete-time D-FBSDEs by applying backward iterative induction. Finally the explicit solution of the continuous-time D-FBSDEs is o…
This paper is concerned with a non-zero sum differential game problem of an anticipated forward-backward stochastic differential delayed equation under partial information. We establish a necessary maximum principle and sufficient verification theorem of the game system by virtue of the duality and convex variational method. We apply the theoretical results and stochastic filtering theory to study a linear-quadratic game system and derive the explicit form of the Nash equilibrium point and discuss the existence and uniqueness in particular cases. As an application, we consider a time-delayed p…
The main goal of this paper is to study a stochastic game connected to a system of forward backward stochastic differential equations (FBSDEs) involving delay and so-called noisy memory. We derive suffcient and necessary maximum principles for a set of controls for the players to be a Nash equilibrium in such a game. Furthermore, we study a corresponding FBSDE involving Malliavin derivatives, which (to the best of our knowledge) is a kind of equation which has not been studied before. The maximum principles give conditions for determining the Nash equilibrium of the game. We use this to derive…
The main contributions of this paper are three fold. First, our primary concern is to investigate a class of stochastic recursive delayed control problems which arise naturally with sound backgrounds but have not been well-studied yet. For illustration purpose, some concrete examples are also provided here. We derive the stochastic maximum principle of sufficient condition to the optimal control in both cases with and without control delay. Second, it is interesting that a new class of time-advanced stochastic differential equations (ASDEs) is introduced as the adjoint process via duality rela…
This article is concerned with an optimal control problem derived by mean-field forward-backward stochastic differential equation with noisy observation, where the drift coefficients of the state equation and the observation equation are linear with respect to the state and its expectation. The control problem is different from the existing literature on optimal control for mean-field stochastic systems, and has more applications in mathematical finance, e.g., asset-liability management problem with recursive utility, systematic risk model. Using a backward separation method with a decompositi…
In this paper we study the mean-field backward stochastic differential equations (mean-field bsde) of the form dY(t) =-f(t,Y(t),Z(t),K(t, . ),E[φ(Y(t),Z(t),K(t,.))])dt+Z(t)dB(t) +\int_{R_{0}}K(t,ζ)\tilde{N}(dt,dζ), where B is a Brownian motion, \tilde{N} is the compensated Poisson random measure. Under some mild conditions, we prove the existence and uniqueness of the solution triplet (Y,Z,K). It is commonly believed that there is no comparison theorem for general mean-field bsde. However, we prove a comparison theorem for a subclass of these equations. When the mean-field bsde is linear, we g…
In this paper, we solve an open problem and obtain a general maximum principle for a stochastic optimal control problem where the control domain is an arbitrary non-empty set and all the coefficients (especially the diffusion term and the terminal cost) contain the control and state delay. In order to overcome the difficulty of dealing with the cross term of state and its delay in the variational inequality, we propose a new method: transform a delayed variational equation into a Volterra integral equation without delay, and introduce novel first-order, second-order adjoint equations via the b…
We establish sufficient conditions for the existence and uniqueness of mean-field backward stochastic differential equations with time delayed generator in the sense that at t, the generator may depend on previous values up to a delay constant δ not on the hole past as in Delong and Imkeller [10], [13]. For sufficiently small delay constant δ and for any finite time horizon, we get a unique solution.
The Optimal Control Problem of Stochastic Differential System with Extended Mixed Delays and Applications
Research Center for Mathematics and Interdisciplinary Sciences, Shandong University（山东大学数学交叉科学研究中心）；School of Mathematics, Shandong University（山东大学数学学院）
We investigate a stochastic optimal control problem where the controlled system is depicted as a stochastic differential delayed equation; however, at the terminal time, the state is constrained in a convex set. We firstly introduce an equivalent backward delayed system depicted as a time-delayed backward stochastic differential equation. Then a stochastic maximum principle is obtained by virtue of Ekeland's variational principle. Finally, applications to a state constrained stochastic delayed linear-quadratic control model and a production-consumption choice problem are studied to illustrate …
This paper first studies super linear G-expectation. Uniqueness and existence theorem for backward stochastic differential equations (BSDEs) under super linear expectation is established to provide probabilistic interpretation for the viscosity solution of a class of Hamilton-Jacobi-Bellman equations, including the well known Black-Scholes-Barrenblett equation, arising in the uncertainty volatility model in mathematical finance. We also show that BSDEs under super linear expectation could characterize a class of stochastic control problems. A direct connection between recursive super (sub) str…
This paper deals with the finite horizon optimal control problem for discrete-time Markov jump linear system with input delay. The correlation among the jumping parameters and the input delay are considered simultaneously, which forms the basic difficulty of the design. one of the key techniques is to solve a delayed forward and backward jumping parameter difference equation which is obtained by an improved maximum principle, and the other is the introduction of a "d-step backward formula". Based on the proposed techniques, a necessary and sufficient condition for the existence of the optimal …
This paper deals with partially-observed optimal control problems for the state governed by stochastic differential equation with delay. We develop a stochastic maximum principle for this kind of optimal control problems using a variational method and a filtering technique. Also, we establish a sufficient condition without assumption of the concavity. Two examples shed light on the theoretical results are established in the paper. In particular, in the example of an optimal investment problem with delay, its numerical simulation shows the effect of delay via a discretization technique for forw…
A linear quadratic (LQ) stochastic optimization problem with delay involving weakly-coupled large population is investigated in this paper. Different to classic mean field (MF) game, here agents cooperate with each other to minimize the so-called \emph{social} objective. With the aid of \emph{delayed person-by-person optimality} principle, one arrives at an auxiliary LQ delayed control problem by decentralized information. A decentralized strategy is obtained by feat of an MF type anticipated forward-backward stochastic differential delay equation (AFBSDDE) consistency condition. The discounti…
We consider a general class of mean field control problems described by stochastic delayed differential equations of McKean-Vlasov type. Two numerical algorithms are provided based on deep learning techniques, one is to directly parameterize the optimal control using neural networks, the other is based on numerically solving the McKean-Vlasov forward anticipated backward stochastic differential equation (MV-FABSDE) system. In addition, we establish a necessary and sufficient stochastic maximum principle for this class of mean field control problems with delay based on the differential calculus…
In this paper, we first give the existence and uniqueness theorems for generalized mean-filed delay stochastic differential equations (GMFDSDEs) and mean-field anticipated backward stochastic differential equations (MFABSDEs). Then we study the stochastic maximum principle for generalized mean-filed delay control problem. Since the state is distribution-depending, we define the adjoint equation as a MFABSDE, in which, all the derivatives of coefficients are in Fréchet sense. We deduce the stochastic maximum principle, and also obtain, under some additional assumptions, a sufficient condition f…
We study a coupled system of controlled stochastic differential equations (SDEs) driven by a Brownian motion and a compensated Poisson random measure, consisting of a forward SDE in the unknown process $X(t)$ and a \emph{predictive mean-field} backward SDE (BSDE) in the unknowns $Y(t), Z(t), K(t,\cdot)$. The driver of the BSDE at time $t$ may depend not just upon the unknown processes $Y(t), Z(t), K(t,\cdot)$, but also on the predicted future value $Y(t+δ)$, defined by the conditional expectation $A(t):= E[Y(t+δ) | \mathcal{F}_t]$. \\ We give a sufficient and a necessary maximum principle for …
In this paper, an open problem is solved, for the stochastic optimal control problem with delay where the control domain is nonconvex and the diffusion term contains both control and its delayed term. Inspired by previous results by Øksendal and Sulem [{\it A maximum principle for optimal control of stochastic systems with delay, with applications to finance. In J. M. Menaldi, E. Rofman, A. Sulem (Eds.), Optimal control and partial differential equations, ISO Press, Amsterdam, 64-79, 2000}] and Chen and Wu [{\it Maximum principle for the stochastic optimal control problem with delay and applic…
This paper investigates the linear-quadratic-Gaussian (LQG) mean-field game (MFG) for a class of stochastic delay systems. We consider a large population system in which the dynamics of each player satisfies some forward stochastic differential delay equation (SDDE). The consistency condition or Nash certainty equivalence (NCE) principle is established through an auxiliary mean-field system of anticipated forward-backward stochastic differential equation with delay (AFBSDDE). The wellposedness of such consistency condition system can be further established by some continuation method instead t…
In this paper, we generalise Pontryagin's stochastic maximum principle to controlled McKean-Vlasov equations with anticipating law. The associated new type of delayed backward equations with implicit terminal condition is studied.
This paper is concerned with a stochastic recursive optimal control problem with time delay, where the controlled system is described by a stochastic differential delayed equation (SDDE) and the cost functional is formulated as the solution to a backward SDDE (BSDDE). When there are only the pointwise and distributed time delays in the state variable, a generalized Hamilton-Jacobi-Bellman (HJB) equation for the value function in finite dimensional space is obtained, applying dynamic programming principle. This generalized HJB equation admits a smooth solution when the coefficients satisfy a pa…
Linear-quadratic mixed Stackelberg-zero-sum game for mean-field regime switching system
Shandong University of Finance and Economics（山东财经大学）；Dalian University of Technology（大连理工大学）；The Hong Kong Polytechnic University（香港理工大学）；Imperial College（帝国理工学院）
In this paper we introduce a new procedure to solve nonlinear optimal control problems with delays which exploits indirect methods combined with numerical homotopy procedures. It is known that solving this kind of problems via indirect methods (which arise from the Pontrya-gin Maximum Principle) is complex and computationally demanding because their implementation is faced to two main difficulties: the extremal equations involve forward and backward terms, and besides, the related shooting method has to be carefully initialized. Here, starting from the solution of the non-delayed version of th…
This paper is concerned with the linear quadratic optimal control problem for networked system simultaneously with input delay and Markovian dropout. Different from the results in the literature, we consider the hold-input strategy, which is much more computationally complicated than zero-input strategy, but much better in most cases especially in the transition phase. Necessary and sufficient conditions for the solvability of optimal control problem over a finite horizon are given by the coupled difference Riccati-type equations. Moreover, the networked control system is mean-square stability…
The optimal control problem for discrete-time systems with colored multiplicative noise is discussed in this paper. The problem will be more difficult to deal with than the case of white noise due to the correlation of the adjoining state. By solving the forward and backward stochastic difference equations (FBSDEs), the necessary and sufficient conditions for the solvability of the optimal control problems in both delay-free and one-step input delay case are given.
Closed-loop solvability of delayed control problems: A stochastic Volterra system approach
Nanjing University of Science and Technology（南京理工大学）；Sichuan University（四川大学）；Zhongyuan University of Technology（中原工学院）；Academy of Mathematics and Systems Science, Chinese Academy of Sciences（中国科学院数学与系统科学研究院）；University of Chinese Academy of Sciences（中国科学院大学）
The mean square stabilization problem for discrete-time networked control systems (NCSs) is investigated in this article. What the difference from most previous works is that input delay and packet losses occur simultaneously in the communication channel, moreover, the data packet dropout is modeled as a time-homogeneous Markov process which will bring some difficulties in solving the problem due to the temporal correlation. The contributions in this paper can be summarized as two points. Firstly, the equivalence condition for the solvability of linear quadratic optimal problem in finite horiz…
In this paper we develop necessary conditions for optimality, in the form of the Pontryagin maximum principle, for the optimal control problem of a class of infinite dimensional evolution equations with delay in the state. In the cost functional we allow the final cost to depend on the history of the state. To treat such kind of cost functionals we introduce a new form of anticipated backward stochastic differential equations which plays the role of dual equation associated to the control problem.
In this paper, we prove both necessary and sufficient maximum principles for infinite horizon discounted control problems of stochastic Volterra integral equations with finite delay and a convex control domain. The corresponding adjoint equation is a novel class of infinite horizon anticipated backward stochastic Volterra integral equations. Our results can be applied to discounted control problems of stochastic delay differential equations and fractional stochastic delay differential equations. As an example, we consider a stochastic linear-quadratic regulator problem for a delayed fractional…
This paper investigates a class of unified stochastic linear quadratic Gaussian (LQG) social optima problems involving a large number of weakly-coupled interactive agents under a {generalized} setting. For each individual agent, the control and state process enters both diffusion and drift terms in its linear dynamics, and the control weight might be \emph{indefinite} in cost functional. This setup is {innovative and has great theoretical and realistic significance} as its applications in mathematical finance {(e.g., portfolio selection in mean-variation model)}. Using some \emph{fully-coupled…
