arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2405.09430eess.SYcs.SY
收藏

分析并增强用于老虎机节能远程控制的队列采样

Analyzing and Enhancing Queue Sampling for Energy-Efficient Remote Control of Bandits

Hiba Dakdouk, Mohamed Sana, Mattia Merluzzi

AI总结:

本研究针对多臂老虎机远程控制中通信延迟与可靠性问题,分析队列采样策略对性能的影响,提出新的随机方法,并验证其悔值性能及奖励与能耗的权衡关系。

摘要:

近年来,通信与控制系统的融合在自动驾驶、工业自动化等诸多领域获得了广泛关注。多臂老虎机(MAB)算法已被证实是解决控制问题的有效鲁棒框架。本研究探讨了将MAB算法用于远程设备控制的场景,该场景面临以延迟和可靠性为主要代表的巨大挑战。我们分析了在受控设备的动作反馈通过不可靠通信信道传输并存储在Geo/Geo/1队列的环境中,MAB的运行效能。我们研究了队列采样策略对MAB性能的影响,并提出了一种新的随机方法。我们针对上置信界(UCB)和汤普森采样(TS)两类算法,将该方法在悔值方面的性能与文献中已有的成熟算法进行了对比评估。此外,我们还研究了奖励最大化与能耗最小化之间的权衡关系。

英文摘要:

In recent years, the integration of communication and control systems has gained significant traction in various domains, ranging from autonomous vehicles to industrial automation and beyond. Multi-armed bandit (MAB) algorithms have proven their effectiveness as a robust framework for solving control problems. In this work, we investigate the use of MAB algorithms to control remote devices, which faces considerable challenges primarily represented by latency and reliability. We analyze the effectiveness of MABs operating in environments where the action feedback from controlled devices is transmitted over an unreliable communication channel and stored in a Geo/Geo/1 queue. We investigate the impact of queue sampling strategies on the MAB performance, and introduce a new stochastic approach. Its performance in terms of regret is evaluated against established algorithms in the literature for both upper confidence bound (UCB) and Thompson Sampling (TS) algorithms. Additionally, we study the trade-off between maximizing rewards and minimizing energy consumption.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑