arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1907.01348cs.ROcs.SYeess.SY
收藏

工业机器人时间最优路径跟踪:一种动态无模型强化学习方法

Time-Optimal Path Tracking for Industrial Robots: A Dynamic Model-Free Reinforcement Learning Approach

Jiadong Xiao, Lin Li, Tie Zhang, Yanbiao Zou

摘要:

在追求机器人操作器沿预定路径的时间最优路径跟踪(TOPT)轨迹时,通常使用预先识别的机器人动力学模型来获得完美跟踪所需的最优轨迹。然而,由于不可避免的模型-对象失配,实际测量的转矩和由动态模型计算的转矩之间可能存在很大的误差,这导致获得的轨迹是次优的,甚至是不可行的,超过给定的限制。本文提出了一种面向TOPT的SARSA算法(TOPTO-SARSA),并提出了一种两步法寻找时间最优运动并保证可行性:首先,通过强化学习Agent与运动学模型的交互,使用TOPTO-SARSA算法寻找满足运动学约束的安全轨迹。其次,利用TOPTO-SARSA算法,通过智能体与现实世界的交互来寻找最优轨迹,并保证最后一次交互时的实测力矩满足给定的限制。在一个六自由度机器人上的实验验证了该算法的有效性。

英文摘要:

In pursuit of the time-optimal path tracking (TOPT) trajectory of a robot manipulator along a preset path, a beforehand identified robot dynamic model is usually used to obtain the required optimal trajectory for perfect tracking. However, due to the inevitable model-plant mismatch, there may be a big error between the actually measured torques and the calculated torques by the dynamic model, which causes the obtained trajectory to be suboptimal or even be infeasible by exceeding given limits. This paper presents a TOPT-oriented SARSA algorithm (TOPTO-SARSA) and a two-step method for finding the time-optimal motion and ensuring the feasibility : Firstly, using TOPTO-SARSA to find a safe trajectory that satisfies the kinematic constraints through the interaction between reinforcement learning agent and kinematic model. Secondly, using TOPTO-SARSA to find the optimal trajectory through the interaction between the agent and the real world, and assure the actually measured torques satisfy the given limits at the last interaction. The effectiveness of the proposed algorithm has been verified through experiments on a 6-DOF robot manipulator.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑