The finite state semi-Markov process is a generalization over the Markov chain in which the sojourn time distribution is any general distribution. In this article we provide a sufficient stochastic maximum principle for the optimal control of a semi-Markov modulated jump-diffusion process in which the drift, diffusion and the jump kernel of the jump-diffusion process is modulated by a semi-Markov process. We also connect the sufficient stochastic maximum principle with the dynamic programming equation. We apply our results to finite horizon risk-sensitive control portfolio optimization problem and to a quadratic loss minimization problem.
Throughout this paper, we focused our aim on the problem of optimal control under a risk-sensitive performance functional, where the system is given by a fully coupled forward-backward stochastic differential equation with jump. The risk neutral control system has been used as preliminary step, where the admissible controls are convex, and the optimal solution exists. The necessary as well as sufficient optimality conditions for risk-sensitive performance are proved. At the end of this work, we illustrate our main result by giving an example of mean-variance for risk sensitive control problem …
Reinforcement Learning for Jump-Diffusions, with Financial Applications
Department of Systems Engineering and Engineering Management, The Chinese University of Hong Kong（系统工程与工程管理系，香港中文大学）；Department of Industrial Engineering and Operations Research and The Data Science Institute, Columbia University（工业工程与运营管理系及数据科学研究所，哥伦比亚大学）
This work deals with an optimal asset allocation problem for a defined contribution (DC) pension plan during its accumulation phase. The contribution rate is proportional to the individual's salary, the dynamics of which follows a Heston stochastic volatility model with jumps, and there are common shocks between the salary and the volatility. Since the time horizon of pension management might be long, the influence of inflation is considered in the context. The inflation index is subjected to a Poisson jump and a Brownian uncertainty. The pension plan aims to reduce fluctuations of terminal we…
We study optimal stochastic control problems of general coupled systems of forward-backward stochastic differential equations with jumps. By means of the Itô-Ventzell formula the system is transformed to a controlled backward stochastic partial differential equation (BSPDE) with jumps. Using a comparison principle for such BSPDEs we obtain a general stochastic Hamilton-Jacobi- Bellman (HJB) equation for such control problems. In the classical Markovian case with optimal control of jump diffusions, the equation reduces to the classical HJB equation. The results are applied to study risk minimiz…
We study a financial market where the risky asset is modelled by a geometric Itô-Lévy process, with a singular drift term. This can for example model a situation where the asset price is partially controlled by a company which intervenes when the price is reaching a certain lower barrier. See e.g. Jarrow & Protter for an explanation and discussion of this model in the Brownian motion case. As already pointed out by Karatzas & Shreve (in the continuous setting), this allows for arbitrages in the market. However, the situation in the case of jumps is not clear. Moreover, it is not clear what hap…
This paper is mainly a survey of recent research developments regarding methods for risk minimization in financial markets modeled by Itô-Lévy processes, but it also contains some new results on the underlying stochastic maximum principle. The concept of a convex risk measure is introduced, and two representations of such measures are given, namely: (i) the dual representation and (ii) the representation by means of backward stochastic differential equations (BSDEs) with jumps. Depending on the representation, the corresponding risk minimal portfolio problem is studied, either in the context o…
Existence of stochastic financial equilibria giving rise to semimartingale asset prices is established under a general class of assumptions. These equilibria are expressed in real terms and span complete markets or markets with withdrawal constraints.We deal with random endowment density streams which admit jumps and general time-dependent utility functions on which only regularity conditions are imposed. As an integral part of the proof of the main result, we establish a novel characterization of semimartingale functions.
Fast pricing of American-style options has been a difficult problem since it was first introduced to financial markets in 1970s, especially when the underlying stocks' prices follow some jump-diffusion processes. In this paper, we propose a new algorithm to generate tight upper bounds on the Bermudan option price without nested simulation, under the jump-diffusion setting. By exploiting the martingale representation theorem for jump processes on the dual martingale, we are able to explore the unique structure of the optimal dual martingale and construct an approximation that preserves the mart…
Delta hedging, which plays a crucial rôle in modern financial engineering, is a tracking control design for a "risk-free" management. We utilize the existence of trends in financial time series (Fliess M., Join C.: A mathematical proof of the existence of trends in financial time series, Proc. Int. Conf. Systems Theory: Modelling, Analysis and Control, Fes, 2009. Online: http://hal.inria.fr/inria-00352834/en/) in order to propose a model-free setting for delta hedging. It avoids most of the shortcomings encountered with the now classic Black-Scholes-Merton framework. Several convincing compute…
This article studies a portfolio optimization problem, where the market consisting of several stocks is modeled by a multi-dimensional jump-diffusion process with age-dependent semi-Markov modulated coefficients. We study risk sensitive portfolio optimization on the finite time horizon. We study the problem by using a probabilistic approach to establish the existence and uniqueness of the classical solution to the corresponding Hamilton-Jacobi-Bellman (HJB) equation. We also implement a numerical scheme to investigate the behavior of solutions for different values of the initial portfolio weal…
Mandatory emission trading schemes are being established around the world. Participants of such market schemes are always exposed to risks. This leads to the creation of an accompanying market for emission-linked derivatives. To evaluate the fair prices of such financial products, one needs appropriate models for the evolution of the underlying assets, emission allowance certificates. In this paper, we discuss continuous time diffusion and jump-diffusion models, the latter enabling one to model information shocks that cause jumps in allowance prices. We show that the resulting martingale dynam…
This paper studies the n-player game and the mean field game under the CRRA relative performance on terminal wealth, in which the interaction occurs by peer competition. In the model with n agents, the price dynamics of underlying risky assets depend on a common noise and contagious jump risk modelled by a multi-dimensional nonlinear Hawkes process. With a continuum of agents, we formulate the MFG problem and characterize a deterministic mean field equilibrium in an analytical form under some conditions, allowing us to investigate some impacts of model parameters in the limiting model and disc…
We consider a mean-variance portfolio selection problem in a financial market with contagion risk. The risky assets follow a jump-diffusion model, in which jumps are driven by a multivariate Hawkes process with mutual-excitation effect. The mutual-excitation feature of the Hawkes process captures the contagion risk in the sense that each price jump of an asset increases the likelihood of future jumps not only in the same asset but also in other assets. We apply the stochastic maximum principle, backward stochastic differential equation theory, and linear-quadratic control technique to solve th…
