arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.17156cs.LGcs.RO
收藏

使用强化学习方法对自行车模型进行路径跟随与稳定化

Path Following and Stabilisation of a Bicycle Model using a Reinforcement Learning Approach

Department of Mechatronics, University of Innsbruck(因斯布鲁克大学机电工程系);Department of Biomechanical Engineering, Delft University of Technology(代尔夫特理工大学生物力学工程系)

Sebastian Weyrer, Peter Manzl, A. L. Schwab, Johannes Gerstmayr

AI总结:

本文提出一种基于强化学习的路径跟随与稳定化方法,通过虚拟自行车模型在复杂路径上实现稳定控制,采用PD控制器将转向角度转换为转向力矩,通过课程学习策略优化性能。

摘要:

多年来,复杂控制方法被用于控制自行车运动。强化学习(RL)作为机器学习的一个分支,提供了一种易于部署的代理方法。本文介绍了一种RL方法,用于通过虚拟自行车模型进行路径跟随,同时实现其横向稳定化。自行车模型采用Whipple基准模型和多体系统动力学,无稳定辅助装置。代理仅通过输出转向角度,经PD控制器转换为转向力矩,即可实现路径跟随和稳定化。课程学习被用作先进的训练策略。不同实现的RL框架设置被调查并相互比较。部署代理的性能通过不同类型的路径和测量进行评估。展示了代理在2m/s至7m/s速度下沿复杂路径(包括完整圆圈、蛇形动作和车道变换)进行路径跟随和自行车模型稳定化的能力。使用机器学习的解释方法分析部署代理的功能,并将引入的RL方法与自行车动力学研究领域联系起来。

英文摘要:

Over the years, complex control approaches have been developed to control the motion of a bicycle. Reinforcement Learning (RL), a branch of machine learning, promises easy deployment of so-called agents. Deployed agents are increasingly considered as an alternative to controllers for mechanical systems. The present work introduces an RL approach to do path following with a virtual bicycle model while simultaneously stabilising it laterally. The bicycle, modelled as the Whipple benchmark model and using multibody system dynamics, has no stabilisation aids. The agent succeeds in both path following and stabilisation of the bicycle model exclusively by outputting steering angles, which are converted into steering torques via a PD controller. Curriculum learning is applied as a state-of-the-art training strategy. Different settings for the implemented RL framework are investigated and compared to each other. The performance of the deployed agents is evaluated using different types of paths and measurements. The ability of the deployed agents to do path following and stabilisation of the bicycle model travelling between 2m/s and 7m/s along complex paths including full circles, slalom manoeuvres, and lane changes is demonstrated. Explanatory methods for machine learning are used to analyse the functionality of a deployed agent and link the introduced RL approach with research in the field of bicycle dynamics.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑