Accurate motion prediction of pedestrians, cyclists, and other surrounding vehicles (all called agents) is very important for autonomous driving. Most existing works capture map information through an one-stage interaction with map by vector-based attention, to provide map constraints for social interaction and multi-modal differentiation. However, these methods have to encode all required map rules into the focal agent's feature, so as to retain all possible intentions' paths while at the meantime to adapt to potential social interaction. In this work, a progressive interaction network is proposed to enable the agent's feature to progressively focus on relevant maps, in order to better learn agents' feature representation capturing the relevant map constraints. The network progressively encode the complex influence of map constraints into the agent's feature through graph convolutions at the following three stages: after historical trajectory encoder, after social interaction, and after multi-modal differentiation. In addition, a weight allocation mechanism is proposed for multi-modal training, so that each mode can obtain learning opportunities from a single-mode ground truth. Experiments have validated the superiority of progressive interactions to the existing one-stage interaction, and demonstrate the effectiveness of each component. Encouraging results were obtained in the challenging benchmarks.
TaPD: Temporal-adaptive Progressive Distillation for Observation-Adaptive Trajectory Forecasting in Autonomous Driving
College of Information and Intelligent Science, Donghua University(信息与智能科学学院,东华大学);School of Computing and Information Technology, Great Bay Institute for Advanced Study/Great Bay University(计算与信息技术学院,大澳研究院/大澳大学);Chongqing Chang’an Technology Co., Ltd(重庆长安科技有限公司);ViSiR, Reutlingen University(ViSiR,鲁特大学)
MindDriver: Introducing Progressive Multimodal Reasoning for Autonomous Driving
Amap, Alibaba Group(阿里集团蚂巴公司);The Hong Kong University of Science and Technology(香港科学与技术大学);The Chinese University of Hong Kong(香港中文大学);Xi’an Jiaotong University(西安交通大学)
Machine Learning-Based Vehicle Intention Trajectory Recognition and Prediction for Autonomous Driving
University of Southern California(南加州大学);Virginia Tech(弗吉尼亚理工大学);Miami University(迈阿密大学);Northern Arizona University(北亚利桑那大学);Northeastern University(东北大学)
MGTraj: Multi-Granularity Goal-Guided Human Trajectory Prediction with Recursive Refinement Network
Division of Emerging Interdisciplinary Areas, The Hong Kong University of Science and Technology(新兴交叉领域分校,香港科学与技术大学);Robotics and Autonomous Systems Thrust, The Hong Kong University of Science and Technology (Guangzhou)(机器人与自主系统方向,香港科学与技术大学(广州))
VECTOR-Drive: Tightly Coupled Vision-Language and Trajectory Expert Routing for End-to-End Autonomous Driving
College of Automotive Engineering, Jilin University(吉林大学汽车工程学院);The National Key Laboratory of Automotive Chassis Integration and Bionics, Jilin University(吉林大学汽车底盘集成与生物力学国家级重点实验室);ReeFocus AI Technology(ReeFocus人工智能技术)
MUSCLE-NET: Predicted-Multiscale-Aware Network for Pedestrian Trajectory Forecasting
Guangdong Provincial Key Laboratory of Fully Actuated System Control Theory and Technology, School of Automation and Intelligent Manufacturing, Southern University of Science and Technology (SUSTech), Shenzhen(广东省全主动系统控制理论与技术重点实验室,自动化与智能制造学院,南方科技大学(SUSTech),深圳);Department of Mechanical Engineering, City University of Hong Kong, Hong Kong SAR, China(香港城市大学机械工程系,香港特别行政区,中国)
Towards Deviation-Robust Agent Navigation via Perturbation-Aware Contrastive Learning
Shenzhen Campus of Sun Yat-sen University(中山大学深圳校区);Dark Matter Inc.(暗物质公司);Sun Yat-sen University(中山大学);University of Chinese Academy of Sciences (UCAS)(中国科学院大学);Monash University(莫纳什大学)
Evaluation Is All You Need for Multi-Modal Autonomous Driving
School of Vehicle and Mobility & College of AI, Tsinghua University(清华大学车辆与运载学院与人工智能学院);Dongfeng Motor Corporation Research & Development Institute(东风汽车集团有限公司研发总院)
SIPTraj: Map-Free End-to-End Trajectory Prediction via Physics-Guided Scene Interaction
School of Data Science and Engineering, Xingzhi College, South China Normal University(华南师范大学行知学院数据科学与工程学院);Hong Kong University of Science and Technology(香港科技大学);University of Macau(澳门大学);College of Intelligence Science and Technology, National University of Defense Technology(国防科技大学智能科学学院);School of Electronic Science and Engineering, South China Normal University(华南师范大学电子科学与工程学院)
OmniTrack++: Omnidirectional Multi-Object Tracking by Learning Large-FoV Trajectory Feedback
Hunan University(湖南大学);Zhejiang University(浙江大学);Ant Group(蚂蚁集团);Karlsruhe Institute of Technology(卡尔斯鲁厄理工学院);INSAIT, Sofia University ``St. Kliment Ohridski''(INSAIT,索菲亚大学『圣克莱门特·奥赫里迪斯』)
Multi-Phase Spacecraft Trajectory Optimization via Transformer-Based Reinforcement Learning
Aeronautics & Astronautics, Massachusetts Institute of Technology(航空与宇航科学系,麻省理工学院);Department of Computer Systems Engineering, Universidad Politécnica de Madrid(计算机系统工程系,马德里理工大学)