arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1706.06133cs.AI
收藏

可扩展的机器形态与控制协同优化

Scalable Co-Optimization of Morphology and Control in Embodied Machines

Cornell University(康奈尔大学);University of Wyoming(怀俄明大学);University of Vermont(佛蒙特大学);NASA Ames/SGT Inc(美国国家航空航天局艾姆斯研究中心/SGT公司);Columbia University(哥伦比亚大学)

Nick Cheney, Josh Bongard, Vytas SunSpiral, Hod Lipson

摘要:

随着时间的推移,进化同时塑造了代理人的身体计划和神经系统。相比之下,在人工智能和机器人技术中,机器人的身体规划通常是手工设计的,然后针对该固定设计优化控制策略。同时共同优化体现机器人的形态和控制器的任务仍然是一个挑战。在心理学中,具身认知理论认为,行为源于身体计划和感觉运动控制之间的紧密耦合,这表明了为什么共同优化这两个子系统如此困难:大多数形态的进化变化往往会对感觉运动控制产生不利影响,导致行为表现的整体下降。在这里,我们进一步研究这一假设,并证明了一种技术的“形态创新保护”,暂时减少选择压力最近形态改变的个人,从而使进化一段时间“重新适应”新的形态与随后的控制政策突变。我们展示了这种方法避免局部最优解的潜力,并在广泛变化的初始条件下收敛到类似的高度拟合形态,同时保持适应度的进一步优化。虽然这项技术无疑只是实现具身机器可扩展优化所必须采取的许多步骤中的第一步,但我们希望对当前方法中进化停滞原因的理论洞察将有助于实现机器人设计和行为训练的自动化--同时提供一个研究具身认知理论的测试平台。

英文摘要:

Evolution sculpts both the body plans and nervous systems of agents together over time. In contrast, in AI and robotics, a robot's body plan is usually designed by hand, and control policies are then optimized for that fixed design. The task of simultaneously co-optimizing the morphology and controller of an embodied robot has remained a challenge. In psychology, the theory of embodied cognition posits that behavior arises from a close coupling between body plan and sensorimotor control, which suggests why co-optimizing these two subsystems is so difficult: most evolutionary changes to morphology tend to adversely impact sensorimotor control, leading to an overall decrease in behavioral performance. Here, we further examine this hypothesis and demonstrate a technique for "morphological innovation protection", which temporarily reduces selection pressure on recently morphologically-changed individuals, thus enabling evolution some time to "readapt" to the new morphology with subsequent control policy mutations. We show the potential for this method to avoid local optima and converge to similar highly fit morphologies across widely varying initial conditions, while sustaining fitness improvements further into optimization. While this technique is admittedly only the first of many steps that must be taken to achieve scalable optimization of embodied machines, we hope that theoretical insight into the cause of evolutionary stagnation in current methods will help to enable the automation of robot design and behavioral training -- while simultaneously providing a testbed to investigate the theory of embodied cognition.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑