arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2512.04077cs.ITcs.SYeess.SPeess.SYmath.IT
收藏

半马尔可夫决策过程框架用于最小化错误信息年龄

Semi-Markov Decision Process Framework for Age of Incorrect Information Minimization

University of Maryland, College Park(马里兰大学帕克分校);Bilkent University(比尔肯特大学)

Ismail Cosandal, Sennur Ulukus, Nail Akar

AI总结:

本文提出基于半马尔可夫决策过程的框架,用于最小化远程估计系统中错误信息年龄,通过多阈值策略优化传输和估计成本。

摘要:

对于一个远程估计系统,我们研究了错误信息年龄(AoII),这是一种最近提出的语义感知新鲜度度量。具体来说,我们假设信息源观察一个离散时间有限状态马尔可夫链(DTMC),并采用基于推送的传输方式将状态更新包发送给负责远程估计的监控器。源到监控器的信道延迟假设具有通用的离散时间相位型(DPH)分布,而零延迟反向信道确保源对AoII和远程估计有完美信息。采用多阈值传输策略,当AoII过程超过阈值时触发数据包传输,该阈值可能因估计值而异。在此一般设置中,我们的目标是通过适当选择阈值来最小化任意函数的平均时间AoII和估计的加权和以及传输成本。我们将问题表述为具有与原始DTMC相同状态空间的半马尔可夫决策过程(SMDP),以获得最优的多阈值策略,其中SMDP的参数通过一种名为双模式吸收马尔可夫链(DR-AMC)的新随机工具以及其对应的吸收时间分布名为双模式DPH(DR-DPH)来获得。

英文摘要:

For a remote estimation system, we study age of incorrect information (AoII), which is a recently proposed semantic-aware freshness metric. In particular, we assume an information source observing a discrete-time finite-state Markov chain (DTMC) and employing push-based transmissions of status update packets towards the monitor which is tasked with remote estimation of the source. The source-to-monitor channel delay is assumed to have a general discrete-time phase-type (DPH) distribution, whereas the zero-delay reverse channel ensures that the source has perfect information on AoII and the remote estimate. A multi-threshold transmission policy is employed where packet transmissions are initiated when the AoII process exceeds a threshold which may be different for each estimation value. In this general setting, our goal is to minimize the weighted sum of time average of an arbitrary function of AoII and estimation, and transmission costs, by suitable choice of the thresholds. We formulate the problem as a semi-Markov decision process (SMDP) with the same state-space as the original DTMC to obtain the optimum multi-threshold policy whereas the parameters of the SMDP are obtained by using a novel stochastic tool called dual-regime absorbing Markov chain (DR-AMC), and its corresponding absorption time distribution named as dual-regime DPH (DR-DPH).

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑