Diana Dorobantu
Our purpose is to study a particular class of optimal stopping problems for Markov processes. We justify the value function convexity and we deduce that there exists a boundary function such that the smallest optimal stopping time is the first time when the Markov process passes over the boundary depending on time. Moreover, we propose a method to find the optimal boundary function.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
继续探索
We describe a new construction of a family of measures on a group with the same Poisson boundary. Our approach is based on applying Markov stopping times to an extension of the original random walk.
On differentiability of reward functionals corresponding to Markovian randomized stopping times
本文研究了马尔可夫随机停时相关回报泛函的可微性与连续性，重点指出可微性是推导回报函数解析表达式常用方法的关键要素。
In this paper we consider stopping problems for continuous-time Markov chains under a general risk-sensitive optimization criterion for problems with finite and infinite time horizon. More precisely our aim is to maximize the certainty equivalent of the stopping reward minus cost over the time horizon. We derive optimality equations for the value functions and prove the existence of optimal stopping times. The exponential utility is treated as a special case. In contrast to risk-neutral stopping problems it may be optimal to stop between jumps of the Markov chain. We briefly discuss the influe…
On the existence of Markovian randomized equilibria in Dynkin games of war-of-attrition-type
本文针对消耗战型非零和 Dynkin 博弈，通过构建马尔可夫随机化停止时间的适当拓扑，证明了马尔可夫完美均衡的存在性，填补了随机化情形下马尔可夫停止博弈均衡理论的空白。
We characterize the value function and the optimal stopping time for a large class of optimal stopping problems where the underlying process to be stopped is a fairly general Markov process. The main result is inspired by recent findings for Lévy processes obtained essentially via the Wiener-Hopf factorization. The main ingredient in our approach is the representation of the $β$-excessive functions as expected suprema. A variety of examples is given.
This paper deals with the optimal stopping problem under partial observation for piecewise-deterministic Markov processes. We first obtain a recursive formulation of the optimal filter process and derive the dynamic programming equation of the partially observed optimal stopping problem. Then, we propose a numerical method, based on the quantization of the discrete-time filter process and the inter-jump times, to approximate the value function and to compute an actual $ε$-optimal stopping time. We prove the convergence of the algorithms and bound the rates of convergence.
Markovization of Randomized Stopping Times
本文研究随机停时的马尔可夫化，证明任意可容许强度存在保持关键分布且不增熵的马尔可夫代表，从而将变分问题简化为对马尔可夫强度的优化，并给出唯一最小熵停时及布朗停时的实现结果。
Suppose that $\mathcal C$ is a finite collection of patterns. Observe a Markov chain until one of the patterns in $\mathcal C$ occurs as a run. This time is denoted by $τ$. In this paper, we aim to give an easy way to calculate the mean waiting time $E(τ)$ and the stopping probabilities $P(τ=τ_A)$ with $A\in\mathcal C$, where $τ_A$ is the waiting time until the pattern $A$ appears as a run.
A forward algorithm for a class of Markov zero-sum stopping games
本文提出了一种高效算法，用于计算有限状态空间中马尔可夫零和停止博弈的价值函数，并讨论了迭代次数及计算实现。
In this Note we study optimal stopping problems for strong Markov processes and affine functions. We give a justification of the Snell envelope form using standard results of optimal stopping. We also justify the convexity of the value function, and without a priori restriction to a particular class of stopping times, we deduce that the smallest optimal stopping time is necessarily a hitting time.
This paper is concerned with the solution of the optimal stopping problem associated to the valuation of Perpetual American options driven by continuous time Markov chains. We introduce a new dynamic approach for the numerical pricing of this type of American options where the main idea is to build a monotone sequence of almost excessive functions that are associated to hitting times of explicit sets. Under minimal assumptions about the payoff and the Markov chain, we prove that the value function of an American option is characterized by the limit of this monotone sequence.
We propose a numerical method to approximate the value function for the optimal stopping problem of a piecewise deterministic Markov process (PDMP). Our approach is based on quantization of the post jump location---inter-arrival time Markov chain naturally embedded in the PDMP, and path-adapted time discretization grids. It allows us to derive bounds for the convergence rate of the algorithm and to provide a computable $ε$-optimal stopping time. The paper is illustrated by a numerical example.
Optimal stopping for Markov processes with positive jumps
本文研究实值Markov过程的贴现最优停止问题，基于Dynkin特征和Green核给出价值函数表示公式，并利用Fourier变换求解了电力市场中Levy驱动的Ornstein-Uhlenbeck过程的最优停止实例。
This paper investigates the random horizon optimal stopping problem for measure-valued piecewise deterministic Markov processes (PDMPs). This is motivated by population dynamics applications, when one wants to monitor some characteristics of the individuals in a small population. The population and its individual characteristics can be represented by a point measure. We first define a PDMP on a space of locally finite measures. Then we define a sequence of random horizon optimal stopping problems for such processes. We prove that the value function of the problems can be obtained by iterating …
We consider the optimal stopping problem consisting in, given a strong Markov process, a reward function and a discount rate, finding the stopping time such that the expected reward at the stopping time is maximum. The approach we follow, has two main components: the Dynkin's characterization of the value function as the smallest excessive function dominating the reward; and the Riesz representation of excessive functions in terms of the Green kernel, the main reference being Salminen 85. In the context of one-dimensional diffusions we give a complete characterization of the solution under som…
In this paper, we solve explicitly the optimal stopping problem with random discounting and an additive functional as cost of observations for a regular linear diffusion. We also extend the results to the class of one-sided regular Feller processes. This generalizes the result of Beibel and Lerche [Statist. Sinica 7 (1997) 93-108] and [Teor. Veroyatn. Primen. 45 (2000) 657-669] and Irles and Paulsen [Sequential Anal. 23 (2004) 297-316]. Our approach relies on a combination of techniques borrowed from potential theory and stochastic calculus. We illustrate our results by detailing some new exam…
In this paper, we consider the optimal stopping problem on semi-Markov processes (SMPs) with finite horizon, and aim to establish the existence and computation of optimal stopping times. To achieve the goal, we first develop the main results of finite horizon semi-Markov decision processes (SMDPs) to the case with additional terminal costs, introduce an explicit construction of SMDPs, and prove the equivalence between the optimal stopping problems on SMPs and SMDPs. Then, using the equivalence and the results on SMDPs developed here, we not only show the existence of optimal stopping time of S…
We propose an alternative approach for solving a number of well-studied optimal stopping problems for Lévy processes. Instead of the usual method of guess-and-verify based on martingale properties of the value function, we suggest a more direct method by showing that the general theory of optimal stopping for strong Markov processes together with some elementary observations imply that the stopping set must be of a certain form for the optimal stopping problems we consider. The independence of increments and the strong Markov property of Lévy processes then allow us to use straightforward opti…
Optimal stopping of Gauss-Markov bridges
本文通过时间-空间变换方法求解高斯-马尔可夫桥的非贴现有限时域最优停止问题，证明最优停止边界的Lipschitz连续性并用积分方程唯一解刻画，同时实现Picard迭代算法进行数值计算。
In this paper, we present a discrete-type approximation scheme to solve continuous-time optimal stopping problems based on fully non-Markovian continuous processes adapted to the Brownian motion filtration. The approximations satisfy suitable variational inequalities which allow us to construct $ε$-optimal stopping times and optimal values in full generality. Explicit rates of convergence are presented for optimal values based on reward functionals of path-dependent SDEs driven by fractional Brownian motion. In particular, the methodology allows us to design concrete Monte-Carlo schemes for no…
The paper is concerned with a variant of the continuous-time finite state Markov game of control and stopping where both players can affect transition rates, while only one player can choose a stopping time. We use the dynamic programming principle and reduce this problem to a system of ODEs with unilateral constraints. This system plays the role of the Bellman equation. We show that its solution provides the optimal strategies of the players. Additionally, we prove the existence and uniqueness theorem for the deduced system of ODEs with unilateral constraints.
We propose a method based on continuous time Markov chain approximation to compute the distribution of Parisian stopping times and price Parisian options under general one-dimensional Markov processes. We prove the convergence of the method under a general setting and obtain sharp estimate of the convergence rate for diffusion models. Our theoretical analysis reveals how to design the grid of the CTMC to achieve faster convergence. Numerical experiments are conducted to demonstrate the accuracy and efficiency of our method for both diffusion and jump models. To show the versality of our approa…
Previous authors have considered optimal stopping problems driven by the running maximum of a spectrally negative Lévy process $X$, as well as of a one-dimensional diffusion. Many of the aforementioned results are either implicitly or explicitly dependent on Peskir's maximality principle. In this article, we are interested in understanding how some of the main ideas from these previous works can be brought into the setting of problems driven by the maximum of a class of Markov additive processes (more precisely Markov modulated Lévy processes). Similarly to previous works in the Lévy setting, …
Let X be a continuous-time Markov chain in a finite set I, let h be a mapping of I onto another set, and let Y be defined by Y_t=h(X_t), (for t nonnegative). We address the filtering problem for X in terms of the observation Y, which is not directly affected by noise. We write down explicit equations for the filtering process and show that this is a Markov process with the Feller property. We also prove that it is a piecewise-deterministic Markov process in the sense of Davis, and we identify its characteristics explicitly. We finally solve an optimal stopping problem for X with partial observ…
This paper attempts to study the optimal stopping time for semi-Markov processes (SMPs) under the discount optimization criteria with unbounded cost rates. In our work, we introduce an explicit construction of the equivalent semi-Markov decision processes (SMDPs). The equivalence is embodied in the value functions of SMPs and SMDPs, that is, every stopping time of SMPs can induce a policy of SMDPs such that the value functions are equal, and vice versa. The existence of the optimal stopping time of SMPs is proved by this equivalence relation. Next, we give the optimality equation of the value …
In this article we consider a toy example of an optimal stopping problem driven by fragmentation processes. We show that one can work with the concept of stopping lines to formulate the notion of an optimal stopping problem and moreover, to reduce it to a classical optimal stopping problem for a generalized Ornstein-Uhlenbeck process associated with Bertoin's tagged fragment. We go on to solve the latter using a classical verification technique thanks to the application of aspects of the modern theory of integrated exponential Levy processes.
We consider a non-Markovian optimal stopping problem on finite horizon. We prove that the value process can be represented by means of a backward stochastic differential equation (BSDE), defined on an enlarged probability space, containing a stochastic integral having a one-jump point process as integrator and an (unknown) process with a sign constraint as integrand. This provides an alternative representation with respect to the classical one given by a reflected BSDE. The connection between the two BSDEs is also clarified. Finally, we prove that the value of the optimal stopping problem is t…
Standard Markovian optimal stopping problems are consistent in the sense that the first entrance time into the stopping set is optimal for each initial state of the process. Clearly, the usual concept of optimality cannot in a straightforward way be applied to non-standard stopping problems without this time-consistent structure. This paper is devoted to the solution of time-inconsistent stopping problems with the reward depending on the initial state using an adaptation of Strotz's consistent planning. More precisely, we give a precise equilibrium definition --- of the type subgame perfect Na…
A discrete-time Markov chain can be transformed into a new Markov chain by looking at its states along iterations of an almost surely finite stopping time. By the optional stopping theorem, any bounded harmonic function with respect to the transition function of the original chain is harmonic with respect to the transition function of the transformed chain. The reverse inclusion is in general not true. Our main result provides a sufficient condition on the stopping time which guarantees that the space of bounded harmonic functions for the transformed chain embeds in the space of bounded harmon…
We consider Backward Stochastic Differential Equations in a setting where noise is generated by a countable state, continuous time Markov chain, and the terminal value is prescribed at a stopping time. We show that, given sufficient integrability of the stopping time and a growth bound on the terminal value and BSDE driver, these equations admit unique solutions satisfying the same growth bound (up to multiplication by a constant). This holds without assuming that the driver is monotone in y, that is, our results do not require that the terminal value be discounted at some uniform rate. We sho…
This paper studies an optimal stopping problem for Lévy processes. We give a justification of the form of the Snell envelope using standard results of optimal stopping. We also justify the convexity of the value function, and without a priori restriction to a particular class of stopping times, we deduce that the smallest optimal stopping time is necessarily a hitting time. We propose a method which allows to obtain the optimal threshold. Moreover this method allows to avoid long calculations of the integro-differential operatorused in the usual proofs.
In this paper, we present a Longstaff-Schwartz-type algorithm for optimal stopping time problems based on the Brownian motion filtration. The algorithm is based on Leão, Ohashi and Russo and, in contrast to previous works, our methodology applies to optimal stopping problems for fully non-Markovian and non-semimartingale state processes such as functionals of path-dependent stochastic differential equations and fractional Brownian motions. Based on statistical learning theory techniques, we provide overall error estimates in terms of concrete approximation architecture spaces with finite Vapni…
On the optimal stopping of Gauss-Markov bridges with random pinning points
研究高斯-马尔可夫桥在随机钉扎点下的最优停止问题，通过时空变换等价于随机端点布朗桥停止，证明最优规则与值函数性质，并给出边界结构条件。
On the limit theory of mean field optimal stopping with non-Markov dynamics and common noise
本文研究了非马尔可夫动力学和公共噪声下的平均场最优停时问题，建立了极限理论并证明了强弱表述下价值函数的等价性，同时引入(H)-假设型条件保证等价性。
In this paper, we propose an extension of the forward improvement iteration algorithm, originally introduced in Irle (2006) and recently reconsidered in Miclo and Villeneuve (2021). The main new ingredient is a flexible window parameter describing the look-ahead distance in the improvement step. We consider the framework of a Markovian optimal stopping problem in discrete time with random discounting and infinite time horizon. We prove convergence and show that the additional flexibility may significantly reduce the runtime.
Infinite horizon optimal stopping problems for a Lévy processes with a two-sided reward function are considered. A two-sided verification theorem is presented in terms of the overall supremum and the overall infimum of the process. A result to compute the angle of the value function at the optimal thresholds of the stopping region is given. To illustrate the results, the optimal stopping problem of a compound Poisson process with two-sided exponential jumps and a two-sided payoff function is solved. In this example, the smooth-pasting condition does not hold.
We describe a variational approach to solving optimal stopping problems for diffusion processes, as an alternative to the traditional approach based on the solution of the free-boundary problem. We study smooth pasting conditions from a variational point of view, and give some examples when the solution to free-boundary problem is not the solution to optimal stopping problem. A special attention is paid to threshold strategies which allow reduce optimal stopping problem to more simple one-parametric optimization. Necessary and sufficient conditions for threshold structure of optimal stopping t…
In this paper we compute the stopping times in the game Rock-Paper-Scissors. By exploiting the recurrence relation we compute the mean values of stopping times. On the other hand, by constructing a transition matrix for a Markov chain associated with the game, we get also the distribution of the stopping times and thereby we compute the mean stopping times again. Then we show that the mean stopping times increase exponentially fast as the number of the participants increases.
In this paper we study the optimal stopping problem for Lévy processes studied by Novikov and Shiryayev, Stochastics, 2007 In particular, we are interested in finding the representing measure of the value function. It is seen that that this can be expressed in terms of the Appell polynomials. An important tool in our approach and computations is the Wiener-Hopf factorization.
We extend the Longstaff-Schwartz algorithm for approximately solving optimal stopping problems on high-dimensional state spaces. We reformulate the optimal stopping problem for Markov processes in discrete time as a generalized statistical learning problem. Within this setup we apply deviation inequalities for suprema of empirical processes to derive consistency criteria, and to estimate the convergence rate and sample complexity. Our results strengthen and extend earlier results.
We study a problem when a solution to optimal stopping problem for one-dimensional diffusion will generate by threshold strategy. Namely, we give necessary and sufficient conditions under which an optimal stopping time can be specified as the first time when the process exceeds some level (threshold), and a continuation set is a semi-interval. We give also second-order conditions, which allow to discard such solutions to free-boundary problem that are not the solutions to optimal stopping problem.
Efron type identities for stopping sets and Poisson hulls
研究一般空间上泊松过程的停止集，利用其空间马尔可夫性质推导分布恒等式，结果可推广到有限泊松过程凸包及更一般随机集的相关恒等式。
This article is devoted to the investigation of limit theorems for mixed max-sum processes with renewal type stopping indexes. Limit theorems of weak convergence type are obtained as well as functional limit theorems.
We define a class of reflected backward stochastic differential equation (RBSDE) driven by a marked point process (MPP) and a Brownian motion, where the solution is constrained to stay above a given càdlàg process. The MPP is only required to be non-explosive and to have totally inaccessible jumps. Under suitable assumptions on the coefficients we obtain existence and uniqueness of the solution, using the Snell envelope theory. We use the equation to represent the value function of an optimal stopping problem, and we characterize the optimal strategy. Keywords: reflected backward stochastic di…
Explicit solution of an infinite horizon optimal stopping problem for a Levy processes with a polynomial reward function is given, in terms of the overall supremum of the process, when the solution of the problem is one-sided. The results are obtained via the generalization of known results about the averaging function associated with the problem. This averaging function can be directly computed in case of polynomial rewards. To illustrate this result, examples for general quadratic and cubic polynomials are discussed in case the process is Brownian motion, and the optimal stopping problem for…
The optimal stopping problem for a Hunt processes on $\R$ is considered via the representation theory of excessive functions. In particular, we focus on infinite horizon (or perpetual) problems with one-sided structure, that is, there exists a point $x^*$ such that the stopping region is of the form $[x^*,+\infty)$. Corresponding results for two-sided problems are also indicated. The main result is a spectral representation of the value function in terms of the Green kernel of the process. Specializing in Lévy processes, we obtain, by applying the Wiener-Hopf factorization, a general represent…
Optimal Stopping of Branching Diffusion Processes
本文研究分支扩散过程的最优停止问题，通过动态规划方法在有限维框架下刻画乘法成本的值函数，建立一致连续性、有界性及动态规划原理，并证明其为非线性椭圆型偏微分方程的唯一粘性解。
Given a strongly stationary Markov chain and a finite set of stopping rules, we prove the existence of a polynomial algorithm which projects the Markov chain onto a minimal Markov chain without redundant information. Markov complexity is hence defined and tested on some classical problems.
We study a model of two-player, zero-sum, stopping games with asymmetric information. We assume that the payoff depends on two continuous-time Markov chains (X, Y), where X is only observed by player 1 and Y only by player 2, implying that the players have access to stopping times with respect to different filtrations. We show the existence of a value in mixed stopping times and provide a variational characterization for the value as a function of the initial distribution of the Markov chains. We also prove a verification theorem for optimal stopping rules which allows to construct optimal sto…
Consider a real hyperplane arrangement and let $\mathcal{C}$ denote the occurring chambers. Bidigare, Hanlon and Rockmore introduced a Markov chain on $\mathcal{C}$ which is a generalization of some card shuffling models used in computer science, biology and card games. This paper introduces strong stationary arguments for this Markov chain, which provide explicit bounds for the separation distance.
Markov Process Jump Times and Their Cox Construction
本文证明Cox构造的停时与Feller过程跳跃时间本质相同，并指出可预测停时可表示为连续过程到达零的时刻。
A curious connection exists between the theory of optimal stopping for independent random variables, and branching processes. In particular, for the branching process $Z_n$ with offspring distribution $Y$, there exists a random variable $X$ such that the probability $P(Z_n=0)$ of extinction of the $n$th generation in the branching process equals the value obtained by optimally stopping the sequence $X_1,...,X_n$, where these variables are i.i.d distributed as $X$. Generalizations to the inhomogeneous and infinite horizon cases are also considered. This correspondence furnishes a simple `stoppi…
Optimal stopping of the stable process with state-dependent killing
针对可建模破产的状态依赖杀灭稳定 Lévy 过程，本文利用相关自相似 Markov 过程刻画最优停止问题，并显式给出首次进入区间即停止的最优策略。
We present a method to solve optimal stopping problems in infinite horizon for a Lévy process when the reward function can be non-monotone. To solve the problem we introduce two new objects. Firstly, we define a random variable $η(x)$ which corresponds to the argmax of the reward function. Secondly, we propose a certain integral transform which can be built on any suitable random variable. It turns out that this integral transform constructed from $η(x)$ and applied to the reward function produces an easy and straightforward description of the optimal stopping rule. We check the consistency of…
In the literature on optimal stopping, the problem of maximizing the expected discounted reward over all stopping times has been explicitly solved for some special reward functions (including $(x^+)^ν$, $(e^x-K)^+$, $(K-e^{-x})^+$, $x\in\mathbb{R}$, $ν\in(0,\infty)$ and $K>0$) under general random walks in discrete time and Lévy processes in continuous time (subject to mild integrability conditions). All of such reward functions are continuous, increasing and logconcave while the corresponding optimal stopping times are of threshold type (i.e. the solutions are one-sided). In this paper, we sh…
Let $X=(X_t)_{t\geq 0}$ be a known process and $T$ an unknown random time independent of $X$. Our goal is to derive the distribution of $T$ based on an iid sample of $X_T$. Belomestny and Schoenmakers (2015) propose a solution based the Mellin transform in case where $X$ is a Brownian motion. Applying their technique we construct a non-parametric estimator for the density of $T$ for a self-similar one-dimensional process $X$. We calculate the minimax convergence rate of our estimator in some examples with a particular focus on Bessel processes where we also show asymptotic normality.
In this paper, we study the optimal multiple stopping problem under the filtration consistent nonlinear expectations. The reward is given by a set of random variables satisfying some appropriate assumptions rather than an RCLL process. We first construct the optimal stopping time for the single stopping problem, which is no longer given by the first hitting time of processes. We then prove by induction that the value function of the multiple stopping problem can be interpreted as the one for the single stopping problem associated with a new reward family, which allows us to construct the optim…
Measure-free discrete time stochastic processes in Riesz spaces were formulated and studied by Kuo, Labuschagne and Watson. Aspects relating martingales, stopping times, convergence of these processes as well as various decomposition were considered. Here we formulate and study Markov processes in a measure-free Riesz space setting.
Under the hypothesis of convergence in probability of a sequence of càdlàg processes $(X^n)\_n$ to a càdlàg process $X$, we are interested in the convergence of corresponding values in optimal stopping and also in the convergence of optimal stopping times. We give results under hypothesis of inclusion of filtrations or convergence of filtrations.
This article treats both discrete time and continuous time stopping problems for general Markov processes on the real line with general linear costs. Using an auxiliary function of maximum representation type, conditions are given to guarantee the optimal stopping time to be of threshold type. The optimal threshold is then characterized as the root of that function. For random walks our results condense in the fact that all combinations of concave increasing pay-off functions and convex cost functions lead to a one-sided solution. For Lévy processes an explicit way to obtain the auxiliary func…
扫码添加微信好友，提出您的宝贵建议 👇
💡 备注请填写：网站反馈
发表机构由 AI 从论文文本抽取，如发现错误，欢迎反馈修正建议。