arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2501.01141cs.NI
收藏

具身人工智能增强的车联网:一种集成大语言模型与强化学习的方法

Embodied AI-Enhanced Vehicular Networks: An Integrated Large Language Models and Reinforcement Learning Method

Ruichen Zhang, Changyuan Zhao, Hongyang Du, Dusit Niyato, Jiacheng Wang, Suttinee Sawadsitang, Xuemin Shen, Dong In Kim

AI总结:

本文提出一种融合LLAVA语义提取与GAE-PPO深度强化学习的车联网自适应传输方法,在降低90%以上数据量的同时显著提升QoE并加速收敛。

摘要:

本文通过集成用于语义信息提取的大语言模型(LLMs)和用于决策的深度强化学习(DRL),研究具身人工智能增强的车联网中的自适应传输策略。所提出的框架旨在通过构建一个纳入韦伯-费希纳定律的优化问题来同时优化数据传输效率和决策准确性,该定律作为平衡带宽利用与体验质量(QoE)的度量。具体而言,我们采用大语言与视觉助手(LLAVA)模型从具身人工智能智能体(即车辆)捕获的原始图像数据中提取关键语义信息,在保留车辆通信和决策所需基本内容的同时,将传输数据量减少约90%以上。在动态车辆环境中,我们采用基于广义优势估计的近端策略优化(GAE-PPO)方法,以在不确定性下稳定决策过程。仿真结果表明,LLAVA的注意力图突出显示了模型对相关图像区域的关注,从而增强了语义表示的准确性。此外,与DDPG相比,我们提出的传输策略将QoE提高了多达36%,并且与纯PPO相比,通过将所需步骤减少多达47%来加速收敛。进一步分析表明,自适应语义符号长度在传输质量与带宽之间提供了有效的权衡,当车辆数量从4辆扩展到8辆时,QoE实现了多达61.4%的提升。

英文摘要:

This paper investigates adaptive transmission strategies in embodied AI-enhanced vehicular networks by integrating large language models (LLMs) for semantic information extraction and deep reinforcement learning (DRL) for decision-making. The proposed framework aims to optimize both data transmission efficiency and decision accuracy by formulating an optimization problem that incorporates the Weber-Fechner law, serving as a metric for balancing bandwidth utilization and quality of experience (QoE). Specifically, we employ the large language and vision assistant (LLAVA) model to extract critical semantic information from raw image data captured by embodied AI agents (i.e., vehicles), reducing transmission data size by approximately more than 90\% while retaining essential content for vehicular communication and decision-making. In the dynamic vehicular environment, we employ a generalized advantage estimation-based proximal policy optimization (GAE-PPO) method to stabilize decision-making under uncertainty. Simulation results show that attention maps from LLAVA highlight the model's focus on relevant image regions, enhancing semantic representation accuracy. Additionally, our proposed transmission strategy improves QoE by up to 36\% compared to DDPG and accelerates convergence by reducing required steps by up to 47\% compared to pure PPO. Further analysis indicates that adapting semantic symbol length provides an effective trade-off between transmission quality and bandwidth, achieving up to a 61.4\% improvement in QoE when scaling from 4 to 8 vehicles.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑