Vision-based trajectory prediction is an important task that supports safe and intelligent behaviours in autonomous systems. Many advanced approaches have been proposed over the years with improved spatial and temporal feature extraction. However, human behaviour is naturally diverse and uncertain. Given the past trajectory and surrounding environment information, an agent can have multiple plausible trajectories in the future. To tackle this problem, an essential task named multi-future trajectory prediction (MTP) has recently been studied. This task aims to generate a diverse, acceptable and explainable distribution of future predictions for each agent. In this paper, we present the first survey for MTP with our unique taxonomies and a comprehensive analysis of frameworks, datasets and evaluation metrics. We also compare models on existing MTP datasets and conduct experiments on the ForkingPath dataset. Finally, we discuss multiple future directions that can help researchers develop novel multi-future trajectory prediction systems and other diverse learning tasks similar to MTP.
Hermite Curves as Trajectory Priors for Vision-Language-Action Models
School of Computer Science and Technology, Harbin Institute of Technology (Shenzhen)（哈尔滨工业大学（深圳）计算机科学与技术学院）；Jiangsu Cytoderm Intelligent Technology Co., Ltd.（江苏赛克德智能科技有限公司）；National University of Singapore（新加坡国立大学）
WorldMAP: Bootstrapping Vision-Language Navigation Trajectory Prediction with Generative World Models
Harbin Institute of Technology（哈尔滨工业大学）；Shandong University（山东大学）；Tsinghua University（清华大学）；University of Science and Technology of China（中国科学技术大学）；Zhongguancun Academy（中关村学院）
DynFly: Dynamic-Aware Continuous Trajectory Generation for UAV Vision-Language Navigation in Urban Environments
Beijing Institute of Technology（北京理工大学）；Tsinghua University（清华大学）；Dalian University of Technology（大连理工大学）；Xidian University（西安电子科技大学）；Huazhong University of Science and Technology（华中科技大学）
VECTOR-Drive: Tightly Coupled Vision-Language and Trajectory Expert Routing for End-to-End Autonomous Driving
College of Automotive Engineering, Jilin University（吉林大学汽车工程学院）；The National Key Laboratory of Automotive Chassis Integration and Bionics, Jilin University（吉林大学汽车底盘集成与生物力学国家级重点实验室）；ReeFocus AI Technology（ReeFocus人工智能技术）
Out-of-Sight Embodied Agents: Multimodal Tracking, Sensor Fusion, and Trajectory Forecasting
Department of Electrical and Computer Engineering, Northeastern University（东北大学电气与计算机工程系）；Khoury College of Computer Sciences, Northeastern University（东北大学库里计算机科学学院）
Enhancing Large Vision Model in Street Scene Semantic Understanding through Leveraging Posterior Optimization Trajectory
Department of Electrical and Electronic Engineering, The University of Hong Kong（香港大学电子与电气工程系）；Shenzhen Research Institute of Big Data（大数据研究深圳研究所）；Department of Computer Science and Engineering, Southern University of Science and Technology（南方科技大学计算机科学与工程系）；Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences（中国科学院深圳先进技术研究所）
A Survey on Deep-Learning Approaches for Vehicle Trajectory Prediction in Autonomous Driving
The Chinese University of Hong Kong（香港中文大学）；Southern University of Science and Technology（南方科技大学）；Shenzhen Research Institute of the Chinese University of Hong Kong（香港中文大学深圳研究院）
VOLT: Vision and Language Trajectory Segmentation for Faster-than-Demonstration Policies
Collab , Dept. of Mechanical Engineering, Virginia Tech, Blacksburg, VA 24061（机械工程系，弗吉尼亚理工学院，布莱克斯堡，VA 24061）；Mitsubishi Electric Research Laboratories ( MERL ), Cambridge, MA 02139（三菱电机研究实验室（MERL），剑桥，MA 02139）
From Field to Planning: Learning Temporal Polar Gradient Fields for Vision-based AAV Trajectory Planning in Dynamic Environments
College of Intelligence Science and Technology, National University of Defense Technology（国防科技大学智能科学学院）；College of Automation Engineering, Nanjing University of Aeronautics and Astronautics（南京航空航天大学自动化学院）
Vision-Language Model Predictive Control for Manipulation Planning and Trajectory Generation
School of Control Science and Engineering, Shandong University（山东大学控制科学与工程学院）；Department of Computer Science, The University of Manchester（曼彻斯特大学计算机科学系）
A Unified Framework for Probabilistic Dynamic-, Trajectory- and Vision-based Virtual Fixtures
School of Computation, Information and Technology, Sensor Based Robotic Systems and Intelligent Assistance Systems（计算、信息与技术学院，基于传感器的机器人系统与智能辅助系统）；German Aerospace Center (DLR), Robotics and Mechatronics Center (RMC)（德国航空航天中心（DLR），机器人与机电中心）；Idiap Research Institute（Idiap研究机构）；École Polytechnique Fédérale de Lausanne (EPFL)（瑞士联邦理工学院（EPFL））
Large Foundation Models for Trajectory Prediction in Autonomous Driving: A Comprehensive Survey
Department of Mathematical Sciences, School of Physical sciences, University of Liverpool（利物浦大学数学科学系）；Department of Communications and Networking, School of Advanced Technology, Xi’an Jiaotong-Liverpool University（西安交通大学利物浦大学通讯与网络系）；Thrust of Artificial Intelligence, The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州）人工智能方向）；Deep Interdisciplinary Intelligence Lab, The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州）深度跨学科智能实验室）；School of Mathematics and Statistics, Shandong University（山东大学数学与统计学院）；School of Artificial Intelligence and Computer Science, Nantong University（南通大学人工智能与计算机科学学院）；Thrust of Data Science and Analytics, The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州）数据科学与分析方向）；Institute of Deep Perception Technology, Jiangsu（江苏深度感知技术研究院）
AnchorVLA: Bridging Discrete Decisions and Continuous Trajectories for Vision-Language-Action Planning
School of Vehicle and Mobility, Tsinghua University（清华大学车辆与运载学院）；State Key Laboratory of Intelligent Green Vehicle and Mobility, Tsinghua University（清华大学智能绿色车辆与交通国家重点实验室）；School of Computer Science and Engineering, Southeast University（东南大学计算机科学与工程学院）；Meituan Inc.（美团公司）；Dongfeng Motor Corporation（东风汽车公司）
Admittance-Based Motion Planning with Vision-Guided Initialization for Robotic Manipulators in Self-Driving Laboratories
Department of Electronics Systems, Aalborg University（电子系统系，奥尔堡大学）；Department of Information Technology and Electrical Engineering, Università degli Studi di Napoli Federico II（信息科技与电气工程系，那不勒斯费迪里奇二世大学）
VisioPath: Vision-Language Enhanced Model Predictive Control for Safe Autonomous Navigation in Mixed Traffic
System Engineering Program, Cornell University（Cornell大学系统工程项目）；School of Civil and Environmental Engineering, Cornell University（Cornell大学土木与环境工程学院）；School of Electrical and Computer Engineering, Cornell University（Cornell大学电气与计算机工程学院）
