arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.08592cs.ITcs.NIcs.SYeess.SPeess.SYmath.IT
收藏

面向CTMC信息源的多阈值AoII最优采样策略

Multi-Threshold AoII-Optimum Sampling Policies for CTMC Information Sources

Ismail Cosandal, Nail Akar, Sennur Ulukus

AI总结:

针对CTMC信息源的状态更新系统,为最小化平均AoII并满足采样率约束,提出多阈值ESAT最优策略及两种低复杂度次优策略,通过CSMDP与MRPH分布求解,数值实验验证了其有效性。

摘要:

我们研究由动力学已知的通用有限状态连续时间马尔可夫链(CTMC)信息源构成的状态更新系统的基于推送的采样与传输策略,目标是最小化平均错误信息年龄(AoII)。我们研究的问题场景包含传输呈指数分布延迟的信道,以及平均采样率约束。我们首先证明最优采样与传输策略是一种“多阈值策略”,其阈值同时取决于估计值与原始过程的状态,当瞬时AoII超过对应阈值时需要启动采样与传输,该策略被称为估计与状态感知传输(ESAT)策略。随后,我们将阈值求解问题建模为约束半马尔可夫决策过程(CSMDP)并采用拉格朗日方法求解。此外,我们提出了两种复杂度更低的次优策略,即估计感知传输(EAT)策略和单阈值(ST)策略,对于状态数相对较多的CTMC,可通过这两种策略得到阈值。底层的CSMDP建模依赖于“多区域相位型”(MRPH)分布,它是著名相位型分布的推广,可用于求解转移速率随时间分段变化的CTMC的吸收时间分布。我们通过数值算例验证了所提出的ESAT、EAT和ST采样传输策略的有效性,并与在失步周期内按泊松过程传输数据包的基线方案进行了对比。

英文摘要:

We study push-based sampling and transmission policies for a status update system consisting of a general finite-state continuous-time Markov chain (CTMC) information source with known dynamics, with the goal of minimizing the average age of incorrect information (AoII). The problem setting we investigate involves an exponentially distributed delay channel for transmissions and a constraint on the average sampling rate. We first show that the optimum sampling and transmission policy is a 'multi-threshold policy', where the thresholds depend on both the estimation value and the state of the original process, and sampling and transmission need to be initiated when the instantaneous AoII exceeds the corresponding threshold, called the estimation- and state-aware transmission (ESAT) policy. Subsequently, we formulate the problem of finding the thresholds as a constrained semi-Markov decision process (CSMDP) and the Lagrangian approach. Additionally, we propose two lower complexity sub-optimum policies, namely the estimation-aware transmission (EAT) policy, and the single-threshold (ST) policy, for which it is possible to obtain these thresholds for CTMCs with relatively larger number of states. The underlying CSMDP formulation relies on the 'multi-regime phase-type' (MRPH) distribution which is a generalization of the well-known phase-type distribution, which allows us to obtain the distribution of time until absorption in a CTMC whose transition rates change with respect to time in a piece-wise manner. The effectiveness of the proposed ESAT, EAT and ST sampling and transmission policies are shown through numerical examples, along with comparisons with a baseline scheme that transmits packets according to a Poisson process in out-of-sync periods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑