有限可靠性表示:用于可靠决策的噪声校准信念空间覆盖
Finite Reliability Representations: Noise-Calibrated Belief-Space Covers for Reliable Decision-Making
AI总结:
介绍有限可靠性表示框架,通过可靠性单元覆盖信念空间,核心是区分相关对象,给出非线性连续系统及有限状态POMDPs的构建方法,还引入可靠性熵衡量信念复杂度,给出相关应用。
摘要:
物理传感和驱动噪声水平应告知决策系统可可靠使用的信念分辨率。我们引入有限可靠性表示(FRR),这是一个通过可靠性单元覆盖信念空间的框架:在这些区域内,最优动作值函数Q*(b,u)在动作上最多变化一个容差ε。该框架基于信念而非状态构建,使用覆盖而非等价商,因为近似决策接近性一般不具有传递性。一个关键技术点是,噪声贝叶斯更新不应被视为对任意信念全局收缩。因此,我们分离了三个对象:固定观测滤波器映射、预测观测定律和受控信念转移核。对于非线性连续状态系统,在信念转移核的可达集利普希茨模量下获得FRR。对于有限状态POMDPs,相同的构建在信念单纯形上变得精确:预测是线性的,贝叶斯校正是归一化正线性映射,传感器噪声通过观测分布可区分性进入,驱动不确定性通过动作执行通道进入。在相应的动作值利普希茨条件下,FRR覆盖支持单元恒定策略,其次优性由2ε/(1 - γ)界定。我们还引入可靠性熵,即最小可靠性单元数的对数,作为认证决策相关信念复杂度的度量。该框架区分了表示充分性与由传感、过程和驱动噪声施加的基本性能下限。它适用于有限POMDPs、线性高斯滤波器、局部线性化非线性滤波器以及通过可靠性单元的解析或经验认证的粒子滤波器实现。
英文摘要:
Physical sensing and actuation noise floors should inform how much belief resolution a decision-making system can reliably use. We introduce Finite Reliability Representations (FRR), a framework for covering belief spaces by reliability cells: regions within which the optimal action-value function Q*(b,u) varies by at most a tolerance epsilon, uniformly over actions. The framework is formulated on beliefs rather than states and uses a cover rather than an equivalence quotient, because approximate decision-closeness is not transitive in general. A central technical point is that noisy Bayesian updates should not be treated as globally contractive on arbitrary beliefs. We therefore separate three objects: the fixed-observation filter map, the predictive observation law, and the controlled belief-transition kernel. For nonlinear continuous-state systems, FRR is obtained under a reachable-set Lipschitz modulus for the belief-transition kernel. For finite-state POMDPs, the same construction becomes exact on the belief simplex: prediction is linear, Bayesian correction is a normalized positive linear map, sensor noise enters through observation-distribution distinguishability, and actuation uncertainty enters through an action-execution channel. Under the corresponding action-value Lipschitz condition, an FRR cover supports a cell-constant policy whose suboptimality is bounded by 2 epsilon/(1 - gamma). We also introduce reliability entropy, the logarithm of the minimal number of reliability cells, as a measure of certified decision-relevant belief complexity. The framework distinguishes representation sufficiency from fundamental performance floors imposed by sensing, process, and actuation noise. It applies to finite POMDPs, linear-Gaussian filters, locally linearized nonlinear filters, and particle-filter implementations through analytic or empirical certification of reliability cells.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。