arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 0711.0641math.PR
收藏

一类奇异控制扩散的HJB方程

HJB equations for certain singularly controlled diffusions

Rami Atar, Amarjit Budhiraja, Ruth J. Williams

摘要:

给定一个内部非空的闭有界凸集$\mathcal{W}\subset{\mathbb {R}}^d$,考虑一个控制问题,其中状态过程$W$和控制过程$U$满足\[W_t= w_0+\int_0^t\vartheta(W_s) ds+\int_0^tσ(W_s) dZ_s+GU_t\in \mathcal{W},\qquad t\ge0,\]其中$Z$是一个标准的多维布朗运动,$\vartheta,σ\in C^{0,1}(\mathcal{W})$,$G$是一个固定矩阵,$w_0\in\mathcal{W}$ .过程$U$是局部有界变差的,在给定的闭凸锥$\mathcal{U}\subset{\mathbb{R}}^p$中有增量。给定$g\in C(\mathcal{W})$、$κ\in{\mathbb{R}}^p$和$α>0$,考虑在容许控制$U$上最小化成本\[J(w_0,U)\doteq\mathbb{E}\biggl[\int_0^{\infty}e^{-αs}g(W_s) ds+\int_{[0,\infty)}e^{-αs} d(κ\cdot U_s)\biggr]\]的目标。$g$和$κ\cdot u$($u\in\mathcal{U}$)都可以取正值和负值。本文研究了相应的动态规划方程(DPE),一个具有状态约束边界条件的二阶退化HJB型椭圆型偏微分方程。在可控性条件$G\mathcal{U}={\mathbb{R}}^d$和有限性的$\mathcal{H}(q)=\sup_{u\in\mathcal{U}_1}\{-Gu\cdot q-κ\cdot u\}$,$q\in {\mathbb{R}}^d$,其中$\mathcal{U}_1=\{u\in\mathcal{U}:|Gu|=1\}$,我们表明,成本,这涉及一个不当的积分,是很好的定义。我们确定以下内容:(i)控制问题的值函数满足DPE(在粘性意义下),(ii)条件$\inf_{q\in{\mathbb{R}}^d}\mathcal{H}(q)<0$是DPE解唯一的充要条件.解决方案的存在性和唯一性被证明是连接到一个直观的“无仲裁”的条件。我们的研究结果适用于布朗控制问题,代表正式的扩散近似与随机处理网络的控制问题。

英文摘要:

Given a closed, bounded convex set $\mathcal{W}\subset{\mathbb {R}}^d$ with nonempty interior, we consider a control problem in which the state process $W$ and the control process $U$ satisfy \[W_t= w_0+\int_0^t\vartheta(W_s) ds+\int_0^tσ(W_s) dZ_s+GU_t\in \mathcal{W},\qquad t\ge0,\] where $Z$ is a standard, multi-dimensional Brownian motion, $\vartheta,σ\in C^{0,1}(\mathcal{W})$, $G$ is a fixed matrix, and $w_0\in\mathcal{W}$. The process $U$ is locally of bounded variation and has increments in a given closed convex cone $\mathcal{U}\subset{\mathbb{R}}^p$. Given $g\in C(\mathcal{W})$, $κ\in{\mathbb{R}}^p$, and $α>0$, consider the objective that is to minimize the cost \[J(w_0,U)\doteq\mathbb{E}\biggl[\int_0^{\infty}e^{-αs}g(W_s) ds+\int_{[0,\infty)}e^{-αs} d(κ\cdot U_s)\biggr]\] over the admissible controls $U$. Both $g$ and $κ\cdot u$ ($u\in\mathcal{U}$) may take positive and negative values. This paper studies the corresponding dynamic programming equation (DPE), a second-order degenerate elliptic partial differential equation of HJB-type with a state constraint boundary condition. Under the controllability condition $G\mathcal{U}={\mathbb{R}}^d$ and the finiteness of $\mathcal{H}(q)=\sup_{u\in\mathcal{U}_1}\{-Gu\cdot q-κ\cdot u\}$, $q\in {\mathbb{R}}^d$, where $\mathcal{U}_1=\{u\in\mathcal{U}:|Gu|=1\}$, we show that the cost, that involves an improper integral, is well defined. We establish the following: (i) the value function for the control problem satisfies the DPE (in the viscosity sense), and (ii) the condition $\inf_{q\in{\mathbb{R}}^d}\mathcal{H}(q)<0$ is necessary and sufficient for uniqueness of solutions to the DPE. The existence and uniqueness of solutions are shown to be connected to an intuitive ``no arbitrage'' condition. Our results apply to Brownian control problems that represent formal diffusion approximations to control problems associated with stochastic processing networks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑