arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2401.16236cs.LGcs.ITcs.MAmath.ITmath.OC
收藏

基于动态特征压缩的有效通信

Effective Communication with Dynamic Feature Compression

University of Padova(帕多瓦大学)

Pietro Talli, Francesco Pase, Federico Chiariotti, Andrea Zanella, Michele Zorzi

AI总结:

针对工业远程无线控制中传感数据过载问题,本研究将系统建模为远程POMDP,结合集成VQ-VAE编码与DRL智能体动态调整量化水平实现有效通信,在CartPole基准上性能显著优于传统方法。

摘要:

工业系统的远程无线控制是5G及后续系统的主要应用场景之一:在这类场景中,需要通过无线介质传输的海量传感信息甚至可能使高容量连接过载。因此,通过优化传输策略丢弃无关信息来解决有效通信问题可带来显著优势,但这通常是一项极具挑战性的复杂任务。本研究考虑一个典型系统:观测器需将其传感数据传输给执行任务的机器人(例如工厂中的移动机器人)。我们将该系统建模为远程部分可观测马尔可夫决策过程(Partially Observable Markov Decision Process, POMDP),分析采用面向语义与有效通信的解决方案对系统整体性能的影响。我们通过集成向量量化变分自编码器(Vector Quantized Variational Autoencoder, VQ-VAE)编码拆分通信问题,并训练深度强化学习(Deep Reinforcement Learning, DRL)智能体,结合环境当前状态与过往消息记忆动态调整量化水平。我们在知名的CartPole基准控制问题上测试了所提方法,结果表明其性能较传统方法有显著提升。

英文摘要:

The remote wireless control of industrial systems is one of the major use cases for 5G and beyond systems: in these cases, the massive amounts of sensory information that need to be shared over the wireless medium may overload even high-capacity connections. Consequently, solving the effective communication problem by optimizing the transmission strategy to discard irrelevant information can provide a significant advantage, but is often a very complex task. In this work, we consider a prototypal system in which an observer must communicate its sensory data to a robot controlling a task (e.g., a mobile robot in a factory). We then model it as a remote Partially Observable Markov Decision Process (POMDP), considering the effect of adopting semantic and effective communication-oriented solutions on the overall system performance. We split the communication problem by considering an ensemble Vector Quantized Variational Autoencoder (VQ-VAE) encoding, and train a Deep Reinforcement Learning (DRL) agent to dynamically adapt the quantization level, considering both the current state of the environment and the memory of past messages. We tested the proposed approach on the well-known CartPole reference control problem, obtaining a significant performance increase over traditional approaches.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑