arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2008.00715cs.RO
收藏

学习驾驶(L2D)作为现实世界强化学习的低成本基准

Learning to Drive (L2D) as a Low-Cost Benchmark for Real-World Reinforcement Learning

Aalto University(阿尔托大学)

Ari Viitala, Rinu Boney, Yi Zhao, Alexander Ilin, Juho Kannala

摘要:

我们提出了学习驾驶(L2D),这是现实世界强化学习(RL)的低成本基准。L2D涉及一个简单且可重复的实验设置,其中RL代理必须学习在三个微型轨道上驾驶驴车,仅给出单目图像观察和汽车速度。智能体必须学会从脱离接触中驾驶,这发生在它偏离轨道时。我们提出并开源了我们的训练管道,这使得将任何现有的RL算法应用于驴车的自动驾驶任务变得非常简单。我们测试模仿学习,国家的最先进的无模型,基于模型的算法上提出的L2D基准。我们的研究结果表明,现有的RL算法可以在不到五分钟的交互时间内从头开始学习驾驶汽车。我们证明了RL算法可以从稀疏和嘈杂的脱离中学习,甚至比模仿学习和人类操作员更快。

英文摘要:

We present Learning to Drive (L2D), a low-cost benchmark for real-world reinforcement learning (RL). L2D involves a simple and reproducible experimental setup where an RL agent has to learn to drive a Donkey car around three miniature tracks, given only monocular image observations and speed of the car. The agent has to learn to drive from disengagements, which occurs when it drives off the track. We present and open-source our training pipeline, which makes it straightforward to apply any existing RL algorithm to the task of autonomous driving with a Donkey car. We test imitation learning, state-of-the-art model-free, and model-based algorithms on the proposed L2D benchmark. Our results show that existing RL algorithms can learn to drive the car from scratch in less than five minutes of interaction. We demonstrate that RL algorithms can learn from sparse and noisy disengagement to drive even faster than imitation learning and a human operator.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑