In this paper, we consider a class of stochastic control problems for stochastic differential equations with random coefficients. The control domain need not to be convex but the control process is not allowed to enter in diffusion term. Moreover, the terminal cost involves a non linear term of the expected value of terminal state. Our purpose is to derive a new version of the Pontryagin's stochastic maximum principle by adopting an idea inspired from the work of Peng [S. Peng, Maximum Principle for Stochastic Optimal Control with Nonconvex Control Domain, Lecture Notes in Control & Information Sciences, 114, (1990), pp. 724-732]. More specifically, we show that if we combine the spike perturbation of the optimal control combined with the stochastic Feynman-Kac representation of linear backward stochastic partial differential equations (BSPDE, for short), a new version of the stochastic maximum principle can be derived. We also investigate sufficient conditions of optimality. In the last part of this paper, motivated by our version of SMP, an interesting class of forward backward stochastic partial differential equations is naturally introduced and the solvability of such kind of equations is briefly presented.
In this paper, we consider a partial information two-person zero-sum stochastic differential game problem where the system is governed by a backward stochastic differential equation driven by Teugels martingales associated with a Lévy process and an independent Brownian motion. One sufficient (a verification theorem) and one necessary conditions for the existence of optimal controls are proved. To illustrate the general results, a linear quadratic stochastic differential game problem is discussed.
This paper is mainly concerned with the solutions to both forward and backward mean-field stochastic partial differential equation and the corresponding optimal control problem for mean-field stochastic partial differential equation. We first prove the continuous dependence theorems of forward and backward mean-field stochastic partial differential equations and show the existence and uniqueness of solutions to them. Then we establish necessary and sufficient optimality conditions of the control problem in the form of Pontryagin's maximum principles. To illustrate the theoretical results, we a…
This paper is concerned with the existence of optimal controls for backward stochastic partial differential equations with random coefficients, in which the control systems are represented in an abstract evolution form, i.e. backward stochastic evolution equations. Under some growth and monotonicity conditions on the coefficients and suitable assumptions on the Hamiltonian function, the existence of the optimal control boils down to proving the uniqueness and existence of a solution to the stochastic Hamiltonian system, i.e. a fully coupled forward-backward stochastic evolution equation. Using…
This paper is concerned with a discounted optimal control problem of partially observed forward-backward stochastic systems with jumps on infinite horizon. The control domain is convex and a kind of infinite horizon observation equation is introduced. The uniquely solvability of infinite horizon forward (backward) stochastic differential equation with jumps is obtained and more extended analysis, especially for the backward case, is made. Some new estimates are first given and proved for the critical variational inequality. Then an ergodic maximum principle is obtained by introducing some infi…
This paper presents three versions of maximum principle for a stochastic optimal control problem of Markov regime-switching forward-backward stochastic differential equations with jumps (FBSDEJs). A general sufficient maximum principle for optimal control for a system driven by a Markov regime-switching forward and backward jump-diffusion model is developed. After, an equivalent maximum principle is proved. Malliavin calculus is also employed to derive a general stochastic maximum principle. The latter does not require concavity of Hamiltonian. Applications of the stochastic maximum principle …
In this paper, we study an optimal control problem of linear backward stochastic differential equation (BSDE) with quadratic cost functional under partial information. This problem is solved completely and explicitly by using a stochastic maximum principle and a decoupling technique. By using the maximum principle, a stochastic Hamiltonian system, which is a forward-backward stochastic differential equation (FBSDE) with filtering, is obtained. By decoupling the stochastic Hamiltonian system, three Riccati equations, a BSDE with filtering, and a stochastic differential equation (SDE) with filte…
This paper is concerned with a Stackelberg game of backward stochastic differential equations (BSDEs) with partial information, where the information of the follower is a sub-$σ$-algebra of that of the leader. Necessary and sufficient conditions of the optimality for the follower and the leader are first given for the general problem, by the partial information stochastic maximum principles of BSDEs and forward-backward stochastic differential equations (FBSDEs), respectively. Then a linear-quadratic (LQ) Stackelberg game of BSDEs with partial information is investigated. The state estimate fe…
This paper first makes an attempt to investigate the partial information near optimal control of systems governed by forward-backward stochastic differential equations with observation noise under the assumption of a convex control domain. By Ekeland's variational principle and some basic estimates for state processes and adjoint processes, we establish the necessary conditions for any $\varepsilon $-near optimal control in a local form with an error order of exact $\varepsilon ^{% \frac{1}{2}}.$ Moreover, under additional convexity conditions on Hamiltonian function, we prove that an $\vareps…
This paper is concerned with a non-zero sum differential game problem of an anticipated forward-backward stochastic differential delayed equation under partial information. We establish a necessary maximum principle and sufficient verification theorem of the game system by virtue of the duality and convex variational method. We apply the theoretical results and stochastic filtering theory to study a linear-quadratic game system and derive the explicit form of the Nash equilibrium point and discuss the existence and uniqueness in particular cases. As an application, we consider a time-delayed p…
IIn this paper, we study a partially observed progressive optimal control problem of forward-backward stochastic differential equations with random jumps, where the control domain is not necessarily convex, and the control variable enter into all the coefficients. In our model, the observation equation is not only driven by a Brownian motion but also a Poisson random measure, which also have correlated noises with the state equation. For preparation, we first derive the existence and uniqueness of the solutions to the fully coupled forward-backward stochastic system with random jumps and its e…
Memory-limited partially observable stochastic control (ML-POSC) is the stochastic optimal control problem under incomplete information and memory limitation. In order to obtain the optimal control function of ML-POSC, a system of the forward Fokker-Planck (FP) equation and the backward Hamilton-Jacobi-Bellman (HJB) equation needs to be solved. In this work, we firstly show that the system of HJB-FP equations can be interpreted via the Pontryagin's minimum principle on the probability density function space. Based on this interpretation, we then propose the forward-backward sweep method (FBSM)…
A wide array of image recovery problems can be abstracted into the problem of minimizing a sum of composite convex functions in a Hilbert space. To solve such problems, primal-dual proximal approaches have been developed which provide efficient solutions to large-scale optimization problems. The objective of this paper is to show that a number of existing algorithms can be derived from a general form of the forward-backward algorithm applied in a suitable product space. Our approach also allows us to develop useful extensions of existing algorithms by introducing a variable metric. An illustra…
In this article, we concern a kind of partially observed non-zero sum stochastic differential game based on forward and backward stochastic differential equations (FBSDEs). It is required that each player has his own observation equation, and the corresponding open-loop Nash equilibrium control is required to adapted to the filtration that the observation process generated. To find this open-loop Nash equilibrium point, we prove the maximum principle as a necessary condition of the existence of this point, and give a verification theorem as a sufficient condition to verify it is the real open-…
In this paper, we consider the Forward--Backward proximal splitting algorithm to minimize the sum of two proper convex functions, one of which having a Lipschitz continuous gradient and the other being partly smooth relative to an active manifold $\mathcal{M}$. We propose a generic framework under which we show that the Forward--Backward (i) correctly identifies the active manifold $\mathcal{M}$ in a finite number of iterations, and then (ii) enters a local linear convergence regime that we characterize precisely. This gives a grounded and unified explanation to the typical behaviour that has …
This paper is concerned with the existence and uniqueness of weak solutions to the Cauchy-Dirichlet problem of backward stochastic partial differential equations (BSPDEs) with nonhomogeneous terms of quadratic growth in both the gradient of the first unknown and the second unknown. As an example, we consider a non-Markovian stochastic optimal control problem with cost functional formulated by a quadratic BSDE, where the corresponding value function satisfies the above quadratic BSPDE.
In view of the minimization of a function which is the sum of a differentiable function $f$ and a convex function $g$ we introduce descent methods which can be viewed as produced by inexact auxiliary problem principleor inexact variable metric forward-backward algorithm. Assuming that the global objective function satisfies the Kurdyka-Lojasiewicz inequalitywe prove the convergence of the proposed algorithm weakening assumptions found in previous works.
Fractional Backward Stochastic Partial Differential Equations with Applications to Stochastic Optimal Control of Partially Observed Systems driven by Lévy Processes
We study methods for solving stochastic control problems of systems of forward-backward mean-field equations with delay, in finite or infinite horizon. Necessary and sufficient maximum principles under partial information are given. The results are applied to solve a recursive utility optimal problem
This paper is concerned with the partial information optimal control problem of mean-field type under partial observation, where the system is given by a controlled mean-field forward-backward stochastic differential equation with correlated noises between the system and the observation, moreover the observation coefficients may depend not only on the control process and but also on its probability distribution. Under standard assumptions on the coefficients, necessary and sufficient conditions for optimality of the control problem in the form of Pontryagin's maximum principles are established…
In this paper, we study a class of stochastic optimal control problem with jumps under partial information. More precisely, the controlled systems are described by a fully coupled nonlinear multi- dimensional forward-backward stochastic differential equation driven by a Poisson random measure and an independent multi-dimensional Brownian motion, and all admissible control processes are required to be adapted to a given subfiltration of the filtration generated by the underlying Poisson random measure and Brownian motion. For this type of partial information stochastic optimal control problem, …
In this paper, we present a numerical scheme to solve the initial-boundary value problem for backward stochastic partial differential equations of parabolic type. Based on the Galerkin method, we approximate the original equation by a family of backward stochastic differential equations (BSDEs, for short), and then solve these BSDEs by the time discretization. Combining the truncation with respect to the spatial variable and the backward Euler method on time variable, we obtain the global $L^2$ error estimate.
We consider a problem of optimal control of an infinite horizon system governed by forward-backward stochastic differential equations with delay. Sufficient and necessary maximum principles for optimal control under partial information in infinite horizon are derived. We illustrate our results by an application to a problem of optimal consumption with respect to recursive utility from a cash flow with delay.
In this paper, we study the maximum principle for stochastic optimal control problems of forward-backward stochastic difference systems (FBSΔSs). Two types of FBSΔSs are investigated. The first one is described by a partially coupled forward-backward stochastic difference equation (FBSΔE) and the second one is described by a fully coupled FBSΔE. By adopting an appropriate representation of the product rule and an appropriate formulation of the backward stochastic difference equation (BSΔE), we deduce the adjoint difference equation. Finally, the maximum principle for this optimal control probl…
We study optimal stochastic control problems of general coupled systems of forward-backward stochastic differential equations with jumps. By means of the Itô-Ventzell formula the system is transformed to a controlled backward stochastic partial differential equation (BSPDE) with jumps. Using a comparison principle for such BSPDEs we obtain a general stochastic Hamilton-Jacobi- Bellman (HJB) equation for such control problems. In the classical Markovian case with optimal control of jump diffusions, the equation reduces to the classical HJB equation. The results are applied to study risk minimiz…
We consider an energy storage problem involving a wind farm with a forecasted power output, a stochastic load, an energy storage device, and a connection to the larger power grid with stochastic prices. Electricity prices and wind power forecast errors are modeled using a novel hidden semi-Markov model that accurately replicates not just the distribution of the errors, but also crossing times, capturing the amount of time each process stays above or below some benchmark such as the forecast. This is an important property of stochastic processes involved in storage problems. We show that we ach…
We study a novel general class of multidimensional type-I backward stochastic Volterra integral equations. Toward this goal, we introduce an infinite dimensional system of standard backward SDEs and establish its well-posedness, and we show that it is equivalent to that of a type-I backward stochastic Volterra integral equation. We also establish a representation formula in terms of non-linear semilinear partial differential equation of Hamilton-Jacobi-Bellman type. As an application, we consider the study of time-inconsistent stochastic control from a game-theoretic point of view. We show the…
A linear-quadratic partially observed Stackelberg stochastic differential game with multiple followers and its application to multi-agent formation control
East China University of Science and Technology（华东理工大学）；University of Alberta（阿尔伯塔大学）；Shandong University（山东大学）；Fudan University（复旦大学）
We study the optimal liquidation problems in target zone models using dynamic programming methods. Such control problems allow for stochastic differential equations with reflections and random coefficients. The value function is characterized with a Neumann problem of backward stochastic partial differential equations (BSPDEs) with singular terminal conditions. The existence and the uniqueness of strong solution to such BSPDEs are addressed, which in turn yields the optimal feedback control. In addition, the unique existence of strong solution to Neumann problem of general semilinear BSPDEs in…
Differential games of partial information forward-backward doubly stochastic differential equations and applications
The Hong Kong Polytechnic University（香港理工大学）；School of Mathematics and Statistics, Shandong University at Weihai（山东大学威海数学与统计学院）；School of Mathematics, Shandong University（山东大学数学学院）
Georgia Institute of Technology（佐治亚理工学院）；Emory University（埃默里大学）
This paper presents a novel approach to numerically solve stochastic differential games for nonlinear systems. The proposed approach relies on the nonlinear Feynman-Kac theorem that establishes a connection between parabolic deterministic partial differential equations and forward-backward stochastic differential equations. Using this theorem the Hamilton-Jacobi-Isaacs partial differential equation associated with differential games is represented by a system of forward-backward stochastic differential equations. Numerical solution of the aforementioned system of stochastic differential equati…
Dynkin Game of Stochastic Differential Equations with Random Coefficients, and Associated Backward Stochastic Partial Differential Variational Inequality
South China Normal University（华南师范大学）；Fudan University（复旦大学）；Ajou University（阿尤大学）
We consider the problem of valuation of American (call and put) options written on a dividend paying stock governed by the geometric Brownian motion. We show that the value function has two different but related representations: by means of a solution of some nonlinear backward stochastic differential equation and weak solution to some semilinear partial differential equation.
We establish existence, uniqueness and regularity of solution results for a class of backward stochastic partial differential equations with singular terminal condition. The equation describes the value function of non-Markovian stochastic optimal control problem in which the terminal state of the controlled process is pre-specified. The analysis of such control problems is motivated by models of optimal portfolio liquidation.
This paper considers the problem of uniqueness of the solutions to a class of Markovian backward stochastic differential equations (BSDEs) which are also connected to certain nonlinear partial differential equation (PDE) through a probabilistic representation. Assuming that there is a solution to the BSDE or to the corresponding PDE, we use the probabilistic interpretation to show the uniqueness of the solutions, and provide an example of a stochastic control application.
In this paper, we study the maximum principle for stochastic optimal control problems of forward-backward stochastic difference systems (FBSΔSs) where the uncertainty is modeled by a discrete time, finite state process, rather than white noises. Two types of FBSΔSs are investigated. The first one is described by a partially coupled forward-backward stochastic difference equation (FBSΔE) and the second one is described by a fully coupled FBSΔE. By adopting an appropriate representation of the product rule and an appropriate formulation of the backward stochastic difference equation (BSΔE), we d…
We study utility maximization problem for general utility functions using dynamic programming approach. We consider an incomplete financial market model, where the dynamics of asset prices are described by an $R^d$-valued continuous semimartingale. Under some regularity assumptions we derive backward stochastic partial differential equation (BSPDE) related directly to the primal problem and show that the strategy is optimal if and only if the corresponding wealth process satisfies a certain forward-SDE. As examples the cases of power, exponential and logarithmic utilities are considered.
