arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2105.11299cs.ROcs.SYeess.SY
收藏

自动驾驶的定维和排列不变状态表示

Fixed-Dimensional and Permutation Invariant State Representation of Autonomous Driving

Tsinghua University(清华大学);National University of Singapore(新加坡国立大学)

Jingliang Duan, Dongjie Yu, Shengbo Eben Li, Wenxuan Wang, Yangang Ren, Ziyu Lin, Bo Cheng

摘要:

在本文中,我们提出了一种新的状态表示方法,称为编码求和和级联(ESC),用于自动驾驶决策的状态表示。与现有的状态表示方法不同,ESC适用于可变数量的周围车辆,并且无需手动预先设计排序规则,从而具有更高的表示能力和通用性。所提出的ESC方法引入了一个表示神经网络(NN)来编码每个周围的车辆到一个编码向量,然后添加这些向量,以获得周围的车辆集的表示向量。通过连接的集合表示与其他变量,如自我车辆和道路的指标,我们实现了固定维和排列不变的状态表示。本文进一步证明了,如果表示神经网络的输出维数大于周围所有车辆的变量数,则所提出的ESC方法可以实现单射表示。这意味着通过将ESC表示作为策略输入,我们可以通过使用基于梯度的更新同时优化它们来找到接近最优的表示NN和策略NN。实验表明,与固定排列表示方法相比,该方法提高了对周围车辆的表示能力,相应的近似误差降低了62.2%.

英文摘要:

In this paper, we propose a new state representation method, called encoding sum and concatenation (ESC), for the state representation of decision-making in autonomous driving. Unlike existing state representation methods, ESC is applicable to a variable number of surrounding vehicles and eliminates the need for manually pre-designed sorting rules, leading to higher representation ability and generality. The proposed ESC method introduces a representation neural network (NN) to encode each surrounding vehicle into an encoding vector, and then adds these vectors to obtain the representation vector of the set of surrounding vehicles. By concatenating the set representation with other variables, such as indicators of the ego vehicle and road, we realize the fixed-dimensional and permutation invariant state representation. This paper has further proved that the proposed ESC method can realize the injective representation if the output dimension of the representation NN is greater than the number of variables of all surrounding vehicles. This means that by taking the ESC representation as policy inputs, we can find the nearly optimal representation NN and policy NN by simultaneously optimizing them using gradient-based updating. Experiments demonstrate that compared with the fixed-permutation representation method, the proposed method improves the representation ability of the surrounding vehicles, and the corresponding approximation error is reduced by 62.2%.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑