In this paper, we present a motion planning framework for multi-modal vehicle dynamics. Our proposed algorithm employs transcription of the optimization objective function, vehicle dynamics, and state and control constraints into sparse factor graphs, which -- combined with mode transition constraints -- constitute a composite pose graph. By formulating the multi-modal motion planning problem in composite pose graph form, we enable utilization of efficient techniques for optimization on sparse graphs, such as those widely applied in dual estimation problems, e.g., simultaneous localization and mapping (SLAM). The resulting motion planning algorithm optimizes the multi-modal trajectory, including the location of mode transitions, and is guided by the pose graph optimization process to eliminate unnecessary transitions, enabling efficient discovery of optimized mode sequences from rough initial guesses. We demonstrate multi-modal trajectory optimization in both simulation and real-world experiments for vehicles with various dynamics models, such as an airplane with taxi and flight modes, and a vertical take-off and landing (VTOL) fixed-wing aircraft that transitions between hover and horizontal flight modes.
Efficient Path Planning and Tracking for Multi-Modal Legged-Aerial Locomotion Using Integrated Probabilistic Road Maps (PRM) and Reference Governors (RG)
California Institute of Technology(加州理工学院);Ecole Polytechnique Fédérale de Lausanne(洛桑联邦理工学院);Northeastern University(东北大学)
Energy-Efficient Motion Planning for Multi-Modal Hybrid Locomotion
Computer Science and Artificial Intelligence Laboratory, Massachusetts Institute of Technology(麻省理工学院计算机科学与人工智能实验室);California Institute of Technology(加州理工学院)
Wild-Drive: Off-Road Scene Captioning and Path Planning via Robust Multi-modal Routing and Efficient Large Language Model
School of Instrument Science and Engineering, Southeast University(东南大学仪器科学与工程学院);Southeast University Nanjing Jiangbei New Area Innovation Research Institute(东南大学南京江滨新区创新研究院);National Key Laboratory of Equipment State Sensing and Smart Support, National University of Defense Technology(国防科技大学装备状态感知与智能支撑国家重点实验室);School of Transportation, Shandong University of Science and Technology(山东科技大学交通学院);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)
PlanAgent: A Multi-modal Large Language Agent for Closed-loop Vehicle Motion Planning
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Beijing University of Posts and Telecommunications(北京邮电大学);School of Mechanical Engineering and Automation, Beihang University(北京航空航天大学);Department of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术系);Li Auto(理想汽车)
Bridging Perception and Planning: Towards End-to-End Planning for Signal Temporal Logic Tasks
School of Automation & Intelligent Sensing, Shanghai Jiao Tong University(自动化与智能感知学院,上海交通大学);University of Minnesota, Twin Cities(明尼苏达大学,双城分校);School of Information Science and Technology, University of Science and Technology of China(信息科学与技术学院,中国科学技术大学)
Hierarchical Experience-informed Navigation for Multi-modal Quadrupedal Rebar Grid Traversal
Georgia Institute of Technology(佐治亚理工学院);School of Mechanical Engineering, Georgia Institute of Technology(佐治亚理工学院机械工程学院);SkyMul Inc(SkyMul公司);School of Electrical and Computer Engineering, Georgia Institute of Technology(佐治亚理工学院电气与计算机工程学院)
UniPilot: Enabling GPS-Denied Autonomy Across Embodiments
Department of Engineering Cybernetics, O. S. Bragstads Plass 2D, Norwegian University of Science and Technology (NTNU), Trondheim, Norway(工程 cybernetics 系,挪威科学技术大学(NTNU),特隆赫姆,挪威)
CogDrive: Cognition-Driven Multimodal Prediction-Planning Fusion for Safe Autonomy
Singapore-MIT Alliance for Research and Technology (SMART), Singapore(新加坡-麻省理工联合研究技术联盟);Department of Urban Studies and Planning, Massachusetts Institute of Technology, USA(麻省理工学院城市研究与规划系);School of Vehicle and Mobility, Tsinghua University, China(清华大学车辆与移动系统学院);Department of Mechanical Engineering, National University of Singapore, Singapore(新加坡国立大学机械工程系);Key Laboratory of Road and Traffic Engineering, Ministry of Education, Tongji University, China(同济大学交通工程重点实验室)
LEMMo-Plan: LLM-Enhanced Learning from Multi-Modal Demonstration for Planning Sequential Contact-Rich Manipulation Tasks
School of Computation, Information and Technology, Technical University of Munich(慕尼黑工业大学计算、信息与技术学院);Aalto University(阿尔托大学);Nanjing University (Suzhou Campus)(南京大学苏州校区);Mohamed Bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学)