The planning problem constitutes a fundamental aspect of the autonomous driving framework. Recent strides in representation learning have empowered vehicles to comprehend their surrounding environments, thereby facilitating the integration of learning-based planning strategies. Among these approaches, Imitation Learning stands out due to its notable training efficiency. However, traditional Imitation Learning methodologies encounter challenges associated with the co-variate shift phenomenon. We propose Validity Learning on Failures, VL(on failure), as a remedy to address this issue. The essence of our method lies in deploying a pre-trained planner across diverse scenarios. Instances where the planner deviates from its immediate objectives, such as maintaining a safe distance from obstacles or adhering to traffic rules, are flagged as failures. The states corresponding to these failures are compiled into a new dataset, termed the failure dataset. Notably, the absence of expert annotations for this data precludes the applicability of standard imitation learning approaches. To facilitate learning from the closed-loop mistakes, we introduce the VL objective which aims to discern valid trajectories within the current environmental context. Experimental evaluations conducted on both reactive CARLA simulation and non-reactive log-replay simulations reveal substantial enhancements in closed-loop metrics such as \textit{Score, Progress}, and Success Rate, underscoring the effectiveness of the proposed methodology. Further evaluations against the Bench2Drive benchmark demonstrate that VL(on failure) outperforms the state-of-the-art methods by a large margin.
AppleVLM: End-to-end Autonomous Driving with Advanced Perception and Planning-Enhanced Vision-Language Models
Shenzhen Key Lab for Advanced Motion Control and Modern Automation Equipments(深圳先进运动控制系统与现代自动化装备重点实验室);Guangdong Provincial Key Laboratory of Intelligent Morphing Mechanisms and Adaptive Robotics(广东省智能变形机制与适应机器人省重点实验室);School of Intelligence Science and Engineering(智能科学与工程学院);Harbin Institute of Technology(哈尔滨工业大学);National Key Laboratory of Smart Farm Technologies and Systems(国家智能农业技术与系统重点实验室);Autonomous Driving Center(自动驾驶中心);Shanghai Utopilot Technology Co.Ltd.(上海驭目科技有限公司)
Mitigating Cross-Modal Distraction and Ensuring Geometric Feasibility via Affordance-Guided and Self-Consistent MLLMs for Task Planning in Instruction-Following Manipulation
Department of Computer Science, National Yang Ming Chiao Tung University(计算机科学系,阳明交通大学);Department of Computer Science and Information Engineering, National Taiwan University(计算机科学与信息工程系,台湾大学)
GraphThink: Graph-Enhanced LLM Thinking for Long-Horizon Embodied Task Planning
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);Beijing Academy of Artificial Intelligence(北京人工智能研究院);Tsinghua University(清华大学);The Hong Kong Polytechnic University(香港理工大学)
CAFE-AD: Cross-Scenario Adaptive Feature Enhancement for Trajectory Planning in Autonomous Driving
Institute of Advanced Technology, University of Science and Technology of China (USTC)(中国科学技术大学先进技术研究院);Institute of Artificial Intelligence, Hefei Comprehensive National Science Center(合肥综合性国家科学中心人工智能研究院);School of Artificial Intelligence and Data Science, USTC(中国科学技术大学人工智能与数据科学学院);School of Computer Science and Technology, USTC(中国科学技术大学计算机科学与技术学院)
Curve Trajectory Model for Human Preferred Path Planning of Automated Vehicles
Vehicle Research Center, Szechenyi Istvan University(塞切尼伊什特万大学车辆研究中心);Institute for Computer Science and Control(计算机科学与控制研究所);Robert Bosch Kft(罗伯特·博世有限公司)
Provably Safe Motion Planning Under Unknown Disturbances
Department of Aerospace Engineering Sciences at the University of Colorado Boulder(科罗拉多大学博尔德分校航空航天工程科学系);Department of Aerospace and Ocean Engineering(航空航天与海洋工程系);Delft University of Technology(代尔夫特理工大学);Italian Institute of Artificial Intelligence(意大利人工智能研究所)