Deterministic optimal impulse control problem with terminal state constraint is considered. Due to the appearance of the terminal state constraint, the value function might be discontinuous in general. The main contribution of this paper is the introduction of an intrinsic condition under which the value function is continuous. Then by a Bellman dynamic programming method, the corresponding Hamilton-Jacobi-Bellman type quasi-variational inequality (QVI, for short) is derived for which the value function is a viscosity solution. The issue of whether the value function is characterized as the unique viscosity solution to this QVI is carefully addressed and the answer is left open challengingly.
We consider the optimal control problem of minimizing some quadratic functional over all possible solutions of an internally controlled multi-dimensional heat equation with a periodic terminal state constraint. This problem has a unique optimal solution, which can be characterized by an optimality system derived from the Pontryagin maximum principle. We define two approximations of this optimal control problem. The first one is an impulse approximation, and consists of considering a system of linear heat equations with impulse control. The second one is obtained by the sample-and-hold procedur…
The paper is concerned with a kind of minimal time control problem for the heat equation with impulse controls. The purpose of such a problem is to find an optimal impulse control (among certain control constraint set) steering the solution of the heat equation from a given initial state to a given target set as soon as possible. We will first study the existence and uniqueness of optimal solution for this problem. In the formulation of this problem, there are two parameters: one is the upper bound of the control constraint and the other one is the moment of impulse time. Then, we will establi…
This paper considers an optimal impulse control problem of dynamical systems generated by a flow. The performance criteria are total costs over the infinite time horizon. Apart from the main performance to be minimized, there are multiple constraints on performance functionals of a similar type. Under a natural set of compactness-continuity conditions on the system primitives, we establish a linear programming approach, and prove the existence of a stationary optimal control strategy out of a more general class of randomized strategies. This is done by making use of the tools from Markov decis…
In this paper we find tight sufficient conditions for the continuity of the value of the utility maximization problem from terminal wealth with respect to the convergence in distribution of the underlying processes. We also establish a weak convergence result for the terminal wealths of the optimal portfolios. Finally, we apply our results to the computation of the minimal expected shortfall (shortfall risk) in the Heston model by building an appropriate lattice approximation.
This paper studies an optimal stochastic impulse control problem in a finite horizon with a decision lag, by which we mean that after an impulse is made, a fixed number units of time has to be elapsed before the next impulse is allowed to be made. The continuity of the value function is proved. A suitable version of dynamic programming principle is established, which takes into account the dependence of state process on the elapsed time. The corresponding Hamilton-Jacobi-Bellman (HJB) equation is derived, which exhibit some special feature of the problem. The value function of this optimal imp…
General theorems for existence and uniqueness of viscosity solutions for Hamilton-Jacobi-Bellman quasi-variational inequalities (HJBQVI) with integral term are established. Such nonlinear partial integro-differential equations (PIDE) arise in the study of combined impulse and stochastic control for jump-diffusion processes. The HJBQVI consists of an HJB part (for stochastic control) combined with a nonlocal impulse intervention term. Existence results are proved via stochastic means, whereas our uniqueness (comparison) results adapt techniques from viscosity solution theory. This paper is to o…
We consider an investment problem in which an investor performs capital injections to increase the liquidity of a firm for it to maximise profit from market operations. Each time the investor performs an injection, the investor incurs a fixed transaction cost. In addition to maximising their terminal reward, the investor seeks to minimise the risk of loss of their investment (from a possible firm ruin) by exiting the market at some point in time. We show that the problem can be reformulated in terms of a new stochastic differential game of control and stopping in which one of the players modif…
The concept of turnpike connects the solution of long but finite time horizon optimal control problems with steady state optimal controls. A key ingredient of the analysis of the turnpike is the linear quadratic regulator problem and the convergence of the solution of the associated differential Riccati equation as the terminal time approaches infinity. This convergence has been investigated in linear systems theory in the 1980s. We extend classical system theoretic results for the investigation of turnpike properties of standard state space systems and descriptor systems. We present condition…
We study the existence of a minimal supersolution for backward stochastic differential equations when the terminal data can take the value +$\infty$ with positive probability. We deal with equations on a general filtered probability space and with generators satisfying a general monotonicity assumption. With this minimal supersolution we then solve an optimal stochastic control problem related to portfolio liquidation problems. We generalize the existing results in three directions: firstly there is no assumption on the underlying filtration (except completeness and quasi-left continuity), sec…
Sequential and terminal constraint feasibility of the model predictive control (MPC) play important roles in ensuring MPC control continuity. This study thus investigates these two properties theoretically using an MPC model for vehicle platooning and eco-driving strategy at signalized intersections. This study is served as a supplement material for our paper coming soon.
We consider an optimal switching problem where the terminal reward depends on the entire control trajectory. We show existence of an optimal control by applying a probabilistic technique based on the concept of Snell envelopes. We then apply this result to solve an impulse control problem for stochastic delay differential equations driven by a Brownian motion and an independent compound Poisson process. Furthermore, we show that the studied problem arises naturally when maximizing the revenue from operation of a group of hydro-power plants with hydrological coupling.
We introduce a new class of Backward Stochastic Differential Equations in which the $T$-terminal value $Y_{T}$ of the solution $(Y,Z)$ is not fixed as a random variable, but only satisfies a weak constraint of the form $E[Ψ(Y_{T})]\ge m$, for some (possibly random) non-decreasing map $Ψ$ and some threshold $m$. We name them \textit{BSDEs with weak terminal condition} and obtain a representation of the minimal time $t$-values $Y_{t}$ such that $(Y,Z)$ is a supersolution of the BSDE with weak terminal condition. It provides a non-Markovian BSDE formulation of the PDE characterization obtained fo…
Nonlinear Stochastic Optimal Control and Optimal Stopping using the Fokker-Planck Transformation
Daniel Guggenheim School of Aerospace, Georgia Institute of Technology（佐治亚理工学院丹尼尔·古根海姆航空学院）；Department of Mechanical Engineering, University of Alabama（阿拉巴马大学机械工程系）
In a recent paper, Bouchard, Elie and Reveillac \cite{BER} have studied a new class of Backward Stochastic Differential Equations with weak terminal condition, for which the $T$-terminal value $Y_T$ of the solution $(Y,Z)$ is not fixed as a random variable, but only satisfies a constraint of the form $E[Ψ(Y_T)] \geq m.$ The aim of this paper is to introduce a more general class of BSDEs with {\em nonlinear weak terminal condition}. More precisely, the constraint takes the form $\mathcal{E}^f_{0,T}[Ψ(Y_T)] \geq m,$ where $\mathcal{E}^f$ represents the $f$-conditional expectation associated to a…
The Hamilton-Jacobi-Bellman equation (HJB) associated with the time inhomogeneous singular control problem is a parabolic partial differential equation, and the existence of a classical solution is usually difficult to prove. In this paper, a class of finite horizon stochastic singular control problems of one dimensional diffusion is solved via a time inhomogeneous zero-sum game (Dynkin game). The regularity of the value function of the Dynkin game is investigated, and its integrated form coincides with the value function of the singular control problem. We provide conditions under which a cla…
This lecture notes are intended for the students taking courses in mathematical control theory. They are concerned with the attainability problem with constraints. The exposition is oriented to the linear control problems with the impulse constraints and the possible discontinuity in the coefficients under control actions. In addition, the weakening of constraints is assumed. The ordinary attainable set is replaced with the attraction set. To construct this attraction set we realize the extension procedure; the generalized elements are defined as finitely additive measures with the property of…
Optimal control of the coagulation-fragmentation equation
Laboratoire des Signaux et Systèmes, Université Paris-Saclay, CentraleSupélec, CNRS（信号与系统实验室，巴黎萨克雷大学，中央理工高等学院，法国国家科学研究中心）；Department of Mathematics, Friedrich-Alexander-Universität Erlangen-Nürnberg（埃尔朗根-纽伦堡大学数学系）
The study is devoted to mathematical modeling and optimal control design of longitudinal motions of a rectilinear elastic rod. The control inputs are a force, which is normal to the cross section and distributed piecewise constantly along the rod's axis, as well as two external lumped loads at the ends. It is assumed that the intervals of constancy in the normal force have equal length. Given initial and terminal states with a fixed time horizon, the optimal control problem is to minimize the mean mechanical energy stored in the rod. To solve the problem, two unknown functions are introduced: …
We study the smoothness of the upper and lower value functions of stochastic differential games in the framework of time-homogeneous (possibly degenerate) diffusion processes in a domain, under the assumption that the diffusion, drift and discount coefficients are all independent of the spatial variables. Under suitable conditions (see Assumptions 2.1 and 2.2), we obtain the optimal local Lipschitz continuity of the value functions, provided that the running and terminal payoffs are globally Lipschitz. As applications, we obtain the stochastic representation and optimal interior $C^{0,1}$-regu…
This paper studies the problem of maximizing the expected utility of terminal wealth for a financial agent with an unbounded random endowment, and with a utility function which supports both positive and negative wealth. We prove the existence of an optimal trading strategy within a class of permissible strategies -- those strategies whose wealth process is a supermartingale under all pricing measures with finite relative entropy. We give necessary and sufficient conditions for the absence of utility-based arbitrage, and for the existence of a solution to the primal problem. We consider two ut…
