arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2304.00875eess.SP
收藏

基于AoII的能量收集系统中的最优语义感知采样与传输

Optimal Semantic-aware Sampling and Transmission in Energy Harvesting Systems Through the AoII

Abolfazl Zakeri, Mohammad Moltafet, Marian Codreanu

AI总结:

针对能量收集状态更新系统,以AoII为指标,通过POMDP和深度强化学习实现最优采样与传输策略,有效降低时间平均AoII。

摘要:

我们研究了一个能量收集状态更新系统中的实时跟踪问题,该系统具有马尔可夫源和不完美信道,同时考虑了采样和传输成本。问题的主要挑战源于采样成本导致的源不可观测性。通过使用错误信息年龄(AoII)作为语义感知性能指标,我们的主要目标是找到一个最优策略,在能量因果约束下最小化时间平均AoII。为此,我们制定并解决了一个随机优化问题,将其建模为部分可观测马尔可夫决策过程(POMDP)。更具体地,为了解决主要问题,我们利用信念状态的概念,并将问题转化为信念MDP问题。然后,对于完美信道设置,我们有效地截断相应的信念空间,并使用相对值迭代方法求解MDP问题。对于一般设置,我们提出了一种深度强化学习策略。仿真结果表明,与AoI最优策略和机会基线策略相比,所推导策略的有效性。

英文摘要:

We study a real-time tracking problem in an energy harvesting status update system with a Markov source and an imperfect channel, considering both sampling and transmission costs. The problem primary challenge stems from the non-observability of the source due to the sampling cost. By using the age of incorrect information (AoII) as a semantic-aware performance metric, our main goal is to find an optimal policy that minimizes the time average AoII subject to an energy-causality constraint. To this end, a stochastic optimization problem is formulated and solved by modeling it as a partially observable Markov decision process (POMDP). More specifically, to solve the main problem, we use the notion of a belief state and cast the problem as a belief MDP problem. Then, for the perfect channel setup, we effectively truncate the corresponding belief space and solve the MDP problem using the relative value iteration method. For the general setup, a deep reinforcement learning policy is proposed. The simulation results show the efficacy of the derived policies in comparison to an AoI-optimal policy and an opportunistic baseline policy.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑