arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2312.02649cs.ROcs.LG
收藏

一种用于机器人倒立摆平衡连续控制问题的Q学习方法

A Q-learning approach to the continuous control problem of robot inverted pendulum balancing

University of Coimbra(科英布拉大学)

Mohammad Safeea, Pedro Neto

AI总结:

本文提出用离散动作空间Q-learning解决机器人倒立摆连续控制问题,通过在基于真实数据拟合的仿真环境中训练,并在真实机器人上验证了方法的可行性。

摘要:

本研究评估了离散动作空间强化学习方法(Q-learning)在机器人倒立摆平衡这一连续控制问题中的应用。为加快学习过程并克服在真实机器人系统上直接学习所涉及的技术困难,学习阶段在仿真环境中进行。通过曲线拟合从真实系统采集的数据,推导并实现了系统动力学的数学模型。所提出的方法被证明是可行的,其应用体现在一个真实世界机器人上,该机器人学会了平衡倒立摆。本研究还进一步强调并证明了在仿真中准确表示物理世界的重要性,以便在现实世界中更高效地实现强化学习算法,即使在使用离散动作空间算法来控制连续动作时也是如此。

英文摘要:

This study evaluates the application of a discrete action space reinforcement learning method (Q-learning) to the continuous control problem of robot inverted pendulum balancing. To speed up the learning process and to overcome technical difficulties related to the direct learning on the real robotic system, the learning phase is performed in simulation environment. A mathematical model of the system dynamics is implemented, deduced by curve fitting on data acquired from the real system. The proposed approach demonstrated feasible, featuring its application on a real world robot that learned to balance an inverted pendulum. This study also reinforces and demonstrates the importance of an accurate representation of the physical world in simulation to achieve a more efficient implementation of reinforcement learning algorithms in real world, even when using a discrete action space algorithm to control a continuous action.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑