扩散轨迹优化问题以实现在多指操作中的恢复
Diffusing Trajectory Optimization Problems for Recovery During Multi-Finger Manipulation
AI总结:
本文提出利用扩散模型检测多指操作中的不利状态并优化接触丰富的恢复轨迹,通过蒸馏加速在线执行,在硬件螺丝刀任务中提升性能96%,且是唯一能避免灾难性失败的恢复方法。
摘要:
多指手正成为执行精细操作任务(包括工具使用)的强大平台。然而,环境扰动或执行错误可能阻碍任务性能,促使使用恢复行为以使正常任务执行得以继续。在这项工作中,我们利用扩散模型的最新进展构建了一个框架,该框架能够自主识别何时需要恢复,并优化接触丰富的轨迹以实现恢复。我们使用在任务上训练的扩散模型来估计状态何时不利于任务执行,这被表述为分布外检测问题。然后,我们使用扩散采样将这些状态投影到分布内,并使用轨迹优化来规划接触丰富的恢复轨迹。我们还提出了一种新颖的基于扩散的方法,该方法提炼了这一过程,以高效地扩散恢复轨迹优化问题的完整参数化,包括约束、目标状态和初始化,从而节省在线执行时间。我们将我们的方法与强化学习基线以及其他不显式规划接触交互的方法进行比较,包括在硬件螺丝刀旋转任务上,我们表明使用我们的方法进行恢复可将任务性能提高96%,并且我们的方法是所评估的唯一能够尝试恢复而不会导致灾难性任务失败的方法。视频可在 https://dtourrecovery.github.io/ 找到。
英文摘要:
Multi-fingered hands are emerging as powerful platforms for performing fine manipulation tasks, including tool use. However, environmental perturbations or execution errors can impede task performance, motivating the use of recovery behaviors that enable normal task execution to resume. In this work, we take advantage of recent advances in diffusion models to construct a framework that autonomously identifies when recovery is necessary and optimizes contact-rich trajectories to recover. We use a diffusion model trained on the task to estimate when states are not conducive to task execution, framed as an out-of-distribution detection problem. We then use diffusion sampling to project these states in-distribution and use trajectory optimization to plan contact-rich recovery trajectories. We also propose a novel diffusion-based approach that distills this process to efficiently diffuse the full parameterization, including constraints, goal state, and initialization, of the recovery trajectory optimization problem, saving time during online execution. We compare our method to a reinforcement learning baseline and other methods that do not explicitly plan contact interactions, including on a hardware screwdriver-turning task where we show that recovering using our method improves task performance by 96% and that ours is the only method evaluated that can attempt recovery without causing catastrophic task failure. Videos can be found at https://dtourrecovery.github.io/.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。