arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.09693math.OC

带昂贵信息的连续时间动态决策

Continuous-Time Dynamic Decision Making with Costly Information

Christoph Knochenhauer, Alexander Merkel, Yufei Zhang

AI总结:

该研究针对带部分观测、信息获取有成本的连续时间线性二次高斯控制问题,结合卡尔曼-布西滤波与动态规划将问题简化,推导了半显式最优解,揭示了不确定性与信息获取策略的阈值关系及渐近特性。

摘要:

我们研究了一类带部分观测且信息获取成本高昂的连续时间线性二次高斯控制问题。更具体地说,我们假设状态过程的漂移项由一个不可观测的Ornstein–Uhlenbeck过程(奥恩斯坦-乌伦贝克过程)支配。决策者可以通过开展成本高昂的测试额外获取关于隐藏状态的信息,从而扩充可用信息集。\n 将Kalman–Bucy滤波器(卡尔曼-布西滤波器)与动态规划方法相结合,我们证明该问题可简化为关于不可观测状态条件方差的确定性控制问题。我们以半显式形式推导了最优控制和价值函数,并对模型的定性性质进行了广泛研究。\n 我们证明,最优成本和边际成本均随模型不确定性的增加而上升。我们识别出一个临界阈值:低于该阈值时,最优策略是不获取额外信息;高于该阈值时,连续信息获取是最优的,且获取速率随不确定性的增大而提高。针对二次信息成本,我们推导了当不确定性趋近于零和无穷大时,信息获取速率的精确渐近行为。

英文摘要:

We consider a continuous-time linear-quadratic Gaussian control problem with partial observations and costly information acquisition. More precisely, we assume the drift of the state process to be governed by an unobservable Ornstein--Uhlenbeck process. The decision maker can additionally acquire information on the hidden state by conducting costly tests, thereby augmenting the available information. Combining the Kalman--Bucy filter with a dynamic programming approach, we show that the problem can be reduced to a deterministic control problem for the conditional variance of the unobservable state. Optimal controls and value functions are derived in a semi-explicit form, and we present an extensive study of the qualitative properties of the model. We demonstrate that both the optimal cost and the marginal cost increase with model uncertainty. We identify a critical threshold: below this level, it is optimal not to acquire additional information, whereas above this threshold, continuous information acquisition is optimal, with the rate increasing as uncertainty grows. For quadratic information costs, we derive the precise asymptotic behavior of the acquisition rate as uncertainty approaches zero and infinity.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑