Motivated by a problem of optimal harvesting of natural resources, we study a control problem for Volterra type dynamics driven by time-changed Lévy noises, which are in general not Markovian. To exploit the nature of the noise, we make use of different kind of information flows within a maximum principle approach. For this we work with backward stochastic differential equations (BSDE) with time-change and exploit the non-anticipating stochastic derivative introduced in [15]. We prove both a sufficient and necessary stochastic maximum principle.
We study a stochastic differential game between two players, controlling a forward stochastic Volterra integral equation (FSVIE). Each player has to optimize his own performance functional which includes a backward stochastic differential equation (BSDE). The dynamics considered are driven by time-changed Lévy noises, with absolutely continuous time-change process. We prove a sufficient maximum principle to characterize Nash equilibria and the related optimal strategies. For this we use techniques of control under partial information, and the non-anticipating stochastic derivative. The zero-su…
In this paper, we prove both necessary and sufficient maximum principles for infinite horizon discounted control problems of stochastic Volterra integral equations with finite delay and a convex control domain. The corresponding adjoint equation is a novel class of infinite horizon anticipated backward stochastic Volterra integral equations. Our results can be applied to discounted control problems of stochastic delay differential equations and fractional stochastic delay differential equations. As an example, we consider a stochastic linear-quadratic regulator problem for a delayed fractional…
Solutions of stochastic Volterra (integral) equations are not Markov processes, and therefore classical methods, like dynamic programming, cannot be used to study optimal control problems for such equations. However, we show that by using {\em Malliavin calculus} it is possible to formulate a modified functional type of {\em maximum principle} suitable for such systems. This principle also applies to situations where the controller has only partial information available to base her decisions upon. We present both a sufficient and a necessary maximum principle of this type, and then we use the …
Backward doubly stochastic Volterra integral equations (BDSVIEs, for short) are introduced and studied systematically. Well-posedness of BDSVIEs in the sense of introduced M-solutions is established. A comparison theorem for BDSVIEs is proved. By virtue of the comparison theorem, we derive the existence of solutions for BDSVIEs with continuous coefficients. Furthermore, a duality principle between linear (forward) doubly stochastic Volterra integral equation (FDSVIE, for short) and BDSVIE is obtained. A Pontryagin type maximum principle is also established for an optimal control problem of FDS…
This paper formulates and studies a stochastic maximum principle for forward-backward stochastic Volterra integral equations (FBSVIEs in short), while the control area is assumed to be convex. Then a linear quadratic (LQ in short) problem for backward stochastic Volterra integral equations (BSVIEs in short) is present to illustrate the aforementioned optimal control problem. Motivated by the technical skills in solving above problem, a more convenient and briefer method for the unique solvability of M-solution for BSVIEs is proposed. At last, we will investigate a risk minimization problem by …
Stochastic maximum principle for time-changed forward-backward stochastic control problem with Lévy noise
Yau Mathematical Sciences Center, Tsinghua University(丘成桐数学科学中心,清华大学);Department of Mathematical Sciences, Tsinghua University(数学科学系,清华大学);Department of Automation, Center for Brain-Inspired Computing Research, Tsinghua University(自动化系,脑启发计算研究中心,清华大学)
Infinite horizon backward stochastic Volterra integral equations (BSVIEs for short) are investigated. We prove the existence and uniqueness of the adapted M-solution in a weighted $L^2$-space. Furthermore, we extend some important known results for finite horizon BSVIEs to the infinite horizon setting. We provide a variation of constant formula for a class of infinite horizon linear BSVIEs and prove a duality principle between a linear (forward) stochastic Volterra integral equation (SVIE for short) and an infinite horizon linear BSVIE in a weighted $L^2$-space. As an application, we investiga…
We give a necessary and sufficient condition for the maximum principle of Schrödinger operators in terms of the bottom of the spectrum of time-changed processes. As a corollary, we obtain a sufficient condition for the Liouville property of Schrödinger operators.
This paper studies a time-changed stochastic control problem, where the underlying stochastic process is a Lévy noise time-changed by an inverse subordinator. We establish a maximum principle theory for the time-changed stochastic control problem. We also prove the existence and uniqueness of the corresponding time-changed backward stochastic differential equation involved in the stochastic control problem. Some examples are provided for illustration.
Anticipated backward stochastic Volterra integral equations and their applications to nonzero-sum stochastic differential games
School of Mathematics and Statistics, Hunan First Normal University(湖南第一师范学院数学与统计学院);School of Mathematics and Statistics, Central South University(中南大学数学与统计学院)
We study backward stochastic differential equations (BSDEs) for time-changed Lévy noises when the time-change is independent of the Lévy process. We prove existence and uniqueness of the solution and we obtain an explicit formula for linear BSDEs and a comparison principle. BSDEs naturally appear in control problems. Here we prove a sufficient maximum principle for a general optimal control problem of a system driven by a time-changed Lévy noise. As an illustration we solve the mean-variance portfolio selection problem.
In this paper we study some properties of the generalized Fokker-Planck equation induced by the time-changed fractional Ornstein-Uhlenbeck process. First of all, we exploit some sufficient conditions to show that a mild solution of such equation is actually a classical solution. Then we discuss an isolation result for mild solutions. Finally, we prove the weak maximum principle for strong solutions of the aforementioned equation and then a uniqueness result.
Given a standard Brownian motion $B^μ=(B_t^μ)_{0\le t\le T}$ with drift $μ\in \mathbb{R}$ and letting $S_t^μ=\max_{0\le s\le t}B_s^μ$ for $0\le t\le T$, we consider the optimal prediction problem: \[V=\inf_{0\le τ\le T}\mathsf{E}(B_τ^μ-S_T^μ)^2\] where the infimum is taken over all stopping times $τ$ of $B^μ$. Reducing the optimal prediction problem to a parabolic free-boundary problem we show that the following stopping time is optimal: \[τ_*=\inf \{t_*\le t\le T\mid b_1(t)\le S_t^μ-B_t^μ\le b_2(t)\}\] where $t_*\in [0,T)$ and the functions $t\mapsto b_1(t)$ and $t\mapsto b_2(t)$ are continuo…
Time change is a powerful technique for generating noises and providing flexible models. In the framework of time changed Brownian and Poisson random measures we study the existence and uniqueness of a solution to a general mean-field stochastic differential equation. We consider a mean-field stochastic control problem for mean-field controlled dynamics and we present a necessary and a sufficient maximum principle. For this we study existence and uniqueness of solutions to mean-field backward stochastic differential equations in the context of time change. An example of a centralised control i…
We show a strong maximum principle and an Alexandrov-Bakelman-Pucci estimate for the weak solutions of a Cauchy problem featuring Caputo time-derivatives and non-local operators in space variables given in terms of Bernstein functions of the Laplacian. To achieve this, first we propose a suitable meaning of a weak solution, show their existence and uniqueness, and establish a probabilistic representation in terms of time-changed Brownian motion. As an application, we also discuss an inverse source problem.
We study the space requirements of a sorting algorithm where only items that at the end will be adjacent are kept together. This is equivalent to the following combinatorial problem: Consider a string of fixed length n that starts as a string of 0's, and then evolves by changing each 0 to 1, with then changes done in random order. What is the maximal number of runs of 1's? We give asymptotic results for the distribution and mean. It turns out that, as in many problems involving a maximum, the maximum is asymptotically normal, with fluctuations of order n^{1/2}, and to the first order well appr…