arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2006.08092eess.SYcs.AIcs.ROcs.SY

An online evolving framework for advancing reinforcement-learning based automated vehicle control

The Ohio State University(俄亥俄州立大学);Ford Greenfield Labs(福特格林菲尔德实验室);Ford Motor Company(福特汽车公司)

Teawon Han, Subramanya Nageshrao, Dimitar P. Filev, Umit Ozguner

英文摘要:

In this paper, an online evolving framework is proposed to detect and revise a controller's imperfect decision-making in advance. The framework consists of three modules: the evolving Finite State Machine (e-FSM), action-reviser, and controller modules. The e-FSM module evolves a stochastic model (e.g., Discrete-Time Markov Chain) from scratch by determining new states and identifying transition probabilities repeatedly. With the latest stochastic model and given criteria, the action-reviser module checks validity of the controller's chosen action by predicting future states. Then, if the chosen action is not appropriate, another action is inspected and selected. In order to show the advantage of the proposed framework, the Deep Deterministic Policy Gradient (DDPG) w/ and w/o the online evolving framework are applied to control an ego-vehicle in the car-following scenario where control criteria are set by speed and safety. Experimental results show that inappropriate actions chosen by the DDPG controller are detected and revised appropriately through our proposed framework, resulting in no control failures after a few iterations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑