arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.19709cs.ROcs.SYeess.SY

DreamWaQ++: 基于障碍物感知的四足机器人运动控制与鲁棒多模强化学习

DreamWaQ++: Obstacle-Aware Quadrupedal Locomotion With Resilient Multi-Modal Reinforcement Learning

Urban Robotics Lab., School of Electrical Engineering, KAIST(韩国科学技术院电子工程系城市机器人实验室);KRAFTON(KRAFTON公司);URobotics(URobotics公司);Laboratory for Information and Decision Systems (LIDS), MIT(麻省理工学院信息与决策系统实验室)

I Made Aswin Nahrendra, Byeongho Yu, Minho Oh, Dongkyu Lee, Seunghyun Lee, Hyeonwoo Lee, Hyungtae Lim, Hyun Myung

AI总结:

DreamWaQ++通过鲁棒多模强化学习融合本体和外源感觉,实现四足机器人在复杂环境中的鲁棒运动控制与敏捷性能。

摘要:

四足机器人在导航复杂环境方面具有广阔的应用前景,其运动控制的鲁棒性堪比动物同类。然而,其浮动基配置使其容易受到现实世界不确定性的干扰,导致运动控制面临重大挑战。深度强化学习已成为实现稳健运动控制器的一种可行替代方案。然而,仅依赖本体感觉的方法会牺牲无碰撞运动,因为它们需要前足接触以检测台阶的存在以适应运动步态。同时,引入外源感觉需要长时间精确建模的由外源传感器观察的地图。因此,本文提出了一种新的方法,融合本体感觉和外源感觉,特征是鲁棒的多模强化学习。所提出的方法产生了一个控制器,使四足机器人在各种现实世界课程上表现出敏捷的运动性能,包括粗糙地形、陡坡和高楼台阶,同时保持对分布外情况的鲁棒性。

英文摘要:

Quadrupedal robots hold promising potential for applications in navigating cluttered environments with resilience akin to their animal counterparts. However, their floating base configuration makes them vulnerable to real-world uncertainties, yielding substantial challenges in their locomotion control. Deep reinforcement learning has become one of the plausible alternatives for realizing a robust locomotion controller. However, the approaches that rely solely on proprioception sacrifice collision-free locomotion because they require front-feet contact to detect the presence of stairs to adapt the locomotion gait. Meanwhile, incorporating exteroception necessitates a precisely modeled map observed by exteroceptive sensors over a period of time. Therefore, this work proposes a novel method to fuse proprioception and exteroception featuring a resilient multi-modal reinforcement learning. The proposed method yields a controller that showcases agile locomotion performance on a quadrupedal robot over a myriad of real-world courses, including rough terrains, steep slopes, and high-rise stairs, while retaining its robustness against out-of-distribution situations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑