arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2004.02379eess.SYcs.SY
收藏

事故风险自适应V2X网络的强化学习

Reinforcement Learning for Accident Risk-Adaptive V2X Networking

Seungmo Kim, Byung-Jun Kim

摘要:

随着互联和自动驾驶汽车在实践中变得越来越紧迫,车联网(V2X)通信的重要性也越来越大。关键的挑战是动态性:每辆车都需要识别周围环境的频繁变化,并将其应用于其联网行为。这就是机器学习的必要性。然而,由于学习本身也是动态的,这就要求学习框架本身必须根据环境具有弹性和灵活性。因此,本文提出了一种将强化学习(RL)集成到多址接入调度中的V2X网络框架。具体而言,学习机制被制定为多臂强盗(MAB)问题,这使得车辆,没有任何外部基础设施的帮助下,(i)学习环境,(ii)量化事故风险,以及(iii)根据风险调整其退避计数器。本文的结果表明,所提出的学习协议是能够(i)评估事故风险接近最佳和(ii)作为一个结果,产生一个更高的机会传输的危险车辆。

英文摘要:

The significance of vehicle-to-everything (V2X) communications has been ever increased as connected and autonomous vehicles get more emergent in practice. The key challenge is the dynamicity: each vehicle needs to recognize the frequent changes of the surroundings and apply them to its networking behavior. This is the point where the need for machine learning is highlighted. However, the learning itself is extremely complicated due to the dynamicity as well, which necessitates that the learning framework itself must be resilient and flexible according to the environment. As such, this paper proposes a V2X networking framework integrating reinforcement learning (RL) into scheduling of multiple access. Specifically, the learning mechanism is formulated as a multi-armed bandit (MAB) problem, which enables a vehicle, without any assistance from external infrastructure, to (i) learn the environment, (ii) quantify the accident risk, and (iii) adapt its backoff counter according to the risk. The results of this paper show that the proposed learning protocol is able to (i) evaluate an accident risk close to optimal and (ii) as a result, yields a higher chance of transmission for a dangerous vehicle.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑