In this paper, an online evolving framework is proposed to detect and revise a controller's imperfect decision-making in advance. The framework consists of three modules: the evolving Finite State Machine (e-FSM), action-reviser, and controller modules. The e-FSM module evolves a stochastic model (e.g., Discrete-Time Markov Chain) from scratch by determining new states and identifying transition probabilities repeatedly. With the latest stochastic model and given criteria, the action-reviser module checks validity of the controller's chosen action by predicting future states. Then, if the chosen action is not appropriate, another action is inspected and selected. In order to show the advantage of the proposed framework, the Deep Deterministic Policy Gradient (DDPG) w/ and w/o the online evolving framework are applied to control an ego-vehicle in the car-following scenario where control criteria are set by speed and safety. Experimental results show that inappropriate actions chosen by the DDPG controller are detected and revised appropriately through our proposed framework, resulting in no control failures after a few iterations.
Evolving Testing Scenario Generation Method and Intelligence Evaluation Framework for Automated Vehicles
School of Automotive Studies, Tongji University(同济大学汽车学院);School of Vehicle and Mobility, Tsinghua University(清华大学车辆与 Mobility学院);School of Mechanical and Aerospace Engineering, Nanyang Technological University(南洋理工大学机械与航天工程学院);College of Transportation Engineering, Tongji University(同济大学交通运输工程学院)
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学)
In recent years, control under urban intersection scenarios becomes an emerging research topic. In such scenarios, the autonomous vehicle confronts complicated situations since it must deal with the interaction with social vehicles timely while obeying the traffic rules. Generally, the autonomous vehicle is supposed to avoid collisions while pursuing better efficiency. The existing work fails to provide a framework that emphasizes the integrity of the scenarios while being able to deploy and test reinforcement learning(RL) methods. Specifically, we propose a benchmark for training and testing …
LongHarness: Advancing Agentic Reasoning over 100M-Token Corpora via Stateful Evidence Management
Fudan University(复旦大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Peking University(北京大学);Shanghai Jiaotong University(上海交通大学);University of Science and Technology of China(中国科学技术大学);Harbin Institute of Technology(哈尔滨工业大学)
Real-time Vehicle-to-Vehicle Communication Based Network Cooperative Control System through Distributed Database and Multimodal Perception: Demonstrated in Crossroads
Zhejiang University(浙江大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of Michigan(密歇根大学)
Generic Evolving Self-Organizing Neuro-Fuzzy Control of Bio-inspired Unmanned Aerial Vehicles
University of New South Wales at the Australian Defence Force Academy(新南威尔士大学澳大利亚国防军学院);Nanyang Technological University(南洋理工大学);National University of Singapore(新加坡国立大学)
California Institute of Technology(加州理工学院);Ford Research and Innovation Center(福特研究与创新中心);University of Michigan(密歇根大学)
This work gives introduction to traffic control by connected automated vehicles. The influence of vehicle control on vehicular traffic and traffic control strategies are discussed and compared. It is highlighted that vehicle-to-everything connectivity allows connected automated vehicles to access the state of the traffic behind them such that feedback can be utilized to mitigate evolving congestions. Numerical simulations demonstrate that such connectivity-based traffic control is beneficial for smoothness and energy efficiency of highway traffic. The dynamics and stability of traffic flow, un…
Lateral tracking control of all-wheel steering vehicles with intelligent tires
Department of Electrical Engineering, Linköping University(林奈大学电气工程系);Department of Engineering Cybernetics, NTNU(挪威技术大学工程 cybernetics 系);IEEE Publication Technology Department(IEEE出版技术部)
The multi-source electromechanical coupling makes the energy management of fuel cell electric vehicles (FCEVs) relatively nonlinear and complex especially in the types of 4-wheel-drive (4WD) FCEVs. Accurate state observing for complicated nonlinear system is the basis for fantastic energy managing in FCEVs. Aiming at releasing the energy-saving potential of FCEVs, a novel learning-based robust model predictive control (LRMPC) strategy is proposed for a 4WD FCEV, contributing to suitable power distribution among multiple energy sources. The well-designed strategy based on machine learning (ML) …
University of Surrey(萨里大学);Jaguar Land Rover Limited(捷豹路虎有限公司)
Designing a controller for autonomous vehicles capable of providing adequate performance in all driving scenarios is challenging due to the highly complex environment and inability to test the system in the wide variety of scenarios which it may encounter after deployment. However, deep learning methods have shown great promise in not only providing excellent performance for complex and non-linear control problems, but also in generalising previously learned rules to new scenarios. For these reasons, the use of deep learning for vehicle control is becoming increasingly popular. Although import…