arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2011.09246cs.ROcs.LG
收藏

基于强化学习的Acrobot控制实验研究

Experimental Study on Reinforcement Learning-based Control of an Acrobot

Hamburg University of Technology(汉堡工业大学)

Leo Dostal, Alexej Bespalko, Daniel A. Duecker

AI总结:

本文研究了使用强化学习控制Acrobot的角速度和总能量,通过嵌入式系统实验设计,实现了无驱动摆杆的振荡或完整旋转,并评估了状态空间离散化、回合长度、动作空间和驱动摆杆质量等参数变化对RL控制的影响。

摘要:

我们展示了人工智能(AI)如何使用强化学习(RL)学习控制Acrobot的计算和实验结果。因此,实验设置被设计为嵌入式系统,这在机器人和能量收集应用中备受关注。具体而言,我们研究了Acrobot角速度的控制,以及其总能量的控制,总能量是动能和势能的总和。通过这种方式,RL算法被设计为将Acrobot第一个摆杆的角速度或能量驱动至期望值。借此,实现了Acrobot无驱动摆杆的振荡或完整旋转。此外,对Acrobot控制进行了研究,从而深入了解了状态空间离散化、回合长度、动作空间或驱动摆杆质量对RL控制的影响。通过进一步的多次仿真和实验,评估了参数变化的影响。

英文摘要:

We present computational and experimental results on how artificial intelligence (AI) learns to control an Acrobot using reinforcement learning (RL). Thereby the experimental setup is designed as an embedded system, which is of interest for robotics and energy harvesting applications. Specifically, we study the control of angular velocity of the Acrobot, as well as control of its total energy, which is the sum of the kinetic and the potential energy. By this means the RL algorithm is designed to drive the angular velocity or the energy of the first pendulum of the Acrobot towards a desired value. With this, libration or full rotation of the unactuated pendulum of the Acrobot is achieved. Moreover, investigations of the Acrobot control are carried out, which lead to insights about the influence of the state space discretization, the episode length, the action space or the mass of the driven pendulum on the RL control. By further numerous simulations and experiments the effects of parameter variations are evaluated.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑