arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.01431cs.LGcs.SYeess.SYq-bio.QM
收藏

连续时间 POMDP 的近似控制

Approximate Control for Continuous-Time POMDPs

Technische Universität Darmstadt(达姆施塔特工业大学);Department of Electrical Engineering and Information Technology(电气工程与信息技术学院)

Yannick Eich, Bastian Alt, Heinz Koeppl

AI总结:

针对连续时间、离散状态与动作空间的部分可观测系统,本文用参数化投影近似滤波分布并结合完全可观测控制启发式,提出可扩展决策框架,且在排队和化学反应网络中验证有效。

摘要:

本工作为具有离散状态和动作空间的连续时间部分可观测系统提出了一种决策框架。由于在大状态空间下最优决策变得难以处理,我们对滤波和控制问题采用近似方法,这些方法随状态数量增加仍具有良好的可扩展性。具体而言,我们通过将高维滤波分布投影到一个参数化分布族来对其进行近似,并将其集成到基于完全可观测系统的控制启发式方法中,以获得可扩展策略。我们在包括排队系统和化学反应网络在内的若干部分可观测系统上证明了该方法的有效性。

英文摘要:

This work proposes a decision-making framework for partially observable systems in continuous time with discrete state and action spaces. As optimal decision-making becomes intractable for large state spaces we employ approximation methods for the filtering and the control problem that scale well with an increasing number of states. Specifically, we approximate the high-dimensional filtering distribution by projecting it onto a parametric family of distributions, and integrate it into a control heuristic based on the fully observable system to obtain a scalable policy. We demonstrate the effectiveness of our approach on several partially observed systems, including queueing systems and chemical reaction networks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑