arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1105.1484math.OCmath.PR
收藏

部分可观测Poisson过程的有限时域决策定时

Finite Horizon Decision Timing with Partially Observable Poisson Processes

Michael Ludkovski, Semih Sezer

摘要:

研究了有限时间内信息到达为Poissonian的决策定时问题。在我们的模型中,决策者希望优化她的行动时间,以最大化她的预期回报。奖励取决于不可观测的马尔可夫环境,有关环境的信息通过(复合)泊松观测过程收集。这种系统的例子出现在投资时机,可靠性理论,贝叶斯政权检测和技术采用模型。我们通过研究一个分段确定性过程的最优停止问题来解决这个问题,该过程给出了不可观测环境的后验似然。我们的方法适合于简单的数值实现,我们提出了几个说明性的数值例子。

英文摘要:

We study decision timing problems on finite horizon with Poissonian information arrivals. In our model, a decision maker wishes to optimally time her action in order to maximize her expected reward. The reward depends on an unobservable Markovian environment, and information about the environment is collected through a (compound) Poisson observation process. Examples of such systems arise in investment timing, reliability theory, Bayesian regime detection and technology adoption models. We solve the problem by studying an optimal stopping problem for a piecewise-deterministic process which gives the posterior likelihoods of the unobservable environment. Our method lends itself to simple numerical implementation and we present several illustrative numerical examples.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑