即时自适应:面向单次生命周期机器人部署的行为调制
Adapt On-the-Go: Behavior Modulation for Single-Life Robot Deployment
AI总结:
本文提出 ROAM 方法,利用预训练行为的感知价值在单个测试回合内无监督地即时选择与调整行为,使机器人能快速适应分布外动力学变化,适应效率超现有方法 2 倍。
摘要:
为了在现实世界中取得成功,机器人必须应对与训练期间所见不同的情境。我们研究在部署过程中即时适应此类新场景的问题,方法是利用先前学习行为的多样化库。我们提出的方法——鲁棒自主调制(ROAM)——引入了一种基于预训练行为感知价值的机制,以选择并调整预训练行为来适应当前情境。关键的是,这一适应过程完全在测试时的单个回合内完成,无需任何人类监督。我们证明,ROAM 使机器人能够在仿真和真实 Go1 四足机器人上快速适应动力学变化,甚至在脚上穿着轮滑鞋的情况下成功前进。在面对部署期间各种分布外情境时,我们的方法通过有效地即时选择和调整相关行为,适应效率是现有方法的 2 倍以上。
英文摘要:
To succeed in the real world, robots must cope with situations that differ from those seen during training. We study the problem of adapting on-the-fly to such novel scenarios during deployment, by drawing upon a diverse repertoire of previouslylearned behaviors. Our approach, RObust Autonomous Modulation (ROAM), introduces a mechanism based on the perceived value of pre-trained behaviors to select and adapt pre-trained behaviors to the situation at hand. Crucially, this adaptation process all happens within a single episode at test time, without any human supervision. We demonstrate that ROAM enables a robot to adapt rapidly to changes in dynamics both in simulation and on a real Go1 quadruped, even successfully moving forward with roller skates on its feet. Our approach adapts over 2x as efficiently compared to existing methods when facing a variety of out-of-distribution situations during deployment by effectively choosing and adapting relevant behaviors on-the-fly.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。