arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.09583cs.RO
收藏

偏好对齐的视觉-运动扩散策略用于可变形物体操作

Preference Aligned Visuomotor Diffusion Policies for Deformable Object Manipulation

KTH Royal Institute of Technology(皇家理工学院);INCAR Robotics AB(INCAR机器人有限公司)

Marco Moletta, Michael C. Welle, Danica Kragic

AI总结:

本文提出RKO方法,通过偏好对齐提升机器人对可变形物体操作的个性化性能。

摘要:

人类自然地发展出对操作任务应如何执行的偏好,这些偏好通常是微妙的、个人的,并且难以用语言表达。尽管机器人考虑这些偏好以提高个性化和用户满意度很重要,但在机械操作中,尤其是在处理可变形物体如衣物和织物的背景下,这些偏好仍然很少被探索。在本文中,我们研究如何将预训练的视觉-运动扩散策略适应以反映偏好行为,使用有限的演示。我们介绍了RKO,一种新的偏好对齐方法,它结合了两种最近框架的优势:RPO和KTO。我们评估RKO与常见的偏好学习框架,包括这两个框架以及一个基线的普通扩散策略,在现实世界的衣物折叠任务上,涵盖多种衣物和偏好设置。我们展示了偏好对齐的策略(特别是RKO)在标准扩散策略微调方面表现更优,样本效率也更高。这些结果突显了结构化偏好学习在复杂可变形物体操作任务中实现个性化机器人行为的重要性和可行性。

英文摘要:

Humans naturally develop preferences for how manipulation tasks should be performed, which are often subtle, personal, and difficult to articulate. Although it is important for robots to account for these preferences to increase personalization and user satisfaction, they remain largely underexplored in robotic manipulation, particularly in the context of deformable objects like garments and fabrics. In this work, we study how to adapt pretrained visuomotor diffusion policies to reflect preferred behaviors using limited demonstrations. We introduce RKO, a novel preference-alignment method that combines the benefits of two recent frameworks: RPO and KTO. We evaluate RKO against common preference learning frameworks, including these two, as well as a baseline vanilla diffusion policy, on real-world cloth-folding tasks spanning multiple garments and preference settings. We show that preference-aligned policies (particularly RKO) achieve superior performance and sample efficiency compared to standard diffusion policy fine-tuning. These results highlight the importance and feasibility of structured preference learning for scaling personalized robot behavior in complex deformable object manipulation tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑