基于具有相对位姿编码的异构折线变换器的实时运动预测
Real-Time Motion Prediction via Heterogeneous Polyline Transformer with Relative Pose Encoding
AI总结:
针对自动驾驶中运动预测模块计算开销高和可扩展性差的问题,提出基于相对位姿编码的异构折线变换器(HPTR),通过异步更新token和共享上下文,实现与场景中心方法相当的高效性,并在Waymo和Argoverse-2数据集上达到与先进智能体中心方法相当的性能。
摘要:
自动驾驶系统的现实部署要求其组件在车载环境下实时运行,包括预测周围交通参与者未来轨迹的运动预测模块。现有的以智能体为中心的方法在公开基准上表现优异,但随着待预测智能体数量增加,存在计算开销高和可扩展性差的问题。为解决此问题,我们引入了带相对位姿编码的K近邻注意力机制(KNARPE),这是一种允许成对相对表示被Transformers使用的新型注意力机制。接着,基于KNARPE,我们提出了具有相对位姿编码的异构折线变换器(HPTR),这是一个支持在线推理期间异步更新token的分层框架。通过在智能体间共享上下文并重用未改变的上下文,我们的方法与以场景为中心的方法同样高效,同时性能与最先进的以智能体为中心的方法相当。在Waymo和Argoverse-2数据集上的实验表明,HPTR在不使用昂贵后处理或模型集成的端到端方法中取得了卓越的性能。代码可在https://github.com/zhejz/HPTR获取。
英文摘要:
The real-world deployment of an autonomous driving system requires its components to run on-board and in real-time, including the motion prediction module that predicts the future trajectories of surrounding traffic participants. Existing agent-centric methods have demonstrated outstanding performance on public benchmarks. However, they suffer from high computational overhead and poor scalability as the number of agents to be predicted increases. To address this problem, we introduce the K-nearest neighbor attention with relative pose encoding (KNARPE), a novel attention mechanism allowing the pairwise-relative representation to be used by Transformers. Then, based on KNARPE we present the Heterogeneous Polyline Transformer with Relative pose encoding (HPTR), a hierarchical framework enabling asynchronous token update during the online inference. By sharing contexts among agents and reusing the unchanged contexts, our approach is as efficient as scene-centric methods, while performing on par with state-of-the-art agent-centric methods. Experiments on Waymo and Argoverse-2 datasets show that HPTR achieves superior performance among end-to-end methods that do not apply expensive post-processing or model ensembling. The code is available at https://github.com/zhejz/HPTR.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。