arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.09640cs.RO
收藏

GPT-Fabric:利用预训练基础模型抚平与折叠织物

GPT-Fabric: Smoothing and Folding Fabric by Leveraging Pre-Trained Foundation Models

University of Southern California(南加州大学)

Vedant Raval, Enyu Zhao, Hejia Zhang, Stefanos Nikolaidis, Daniel Seita

AI总结:

本文提出 GPT-Fabric,由 GPT 直接输出抓取与牵拉动作,以零样本方式完成织物抚平与折叠,并在仿真和真实机器人实验中验证其高精度性能。

摘要:

织物操纵在折叠毛毯、处理病人衣物以及用罩布保护物品等方面具有应用。机器人执行织物操纵颇具挑战,因为织物具有无限维构型空间、复杂动力学,并且可能处于折叠或皱缩构型,伴随严重的自遮挡。以往关于机器人织物操纵的工作要么依赖高度工程化的装置,要么依赖基于学习的方法,这些方法需要创建机器人-织物交互数据并在其上训练。本文中,我们针对织物抚平与折叠这两个规范任务提出 GPT-Fabric,其中 GPT 直接输出一个动作,告知机器人应在何处抓取并牵拉织物。我们在仿真中开展大量实验,以测试 GPT-Fabric 相对于以往抚平与折叠方法的表现。GPT-Fabric 在织物抚平方面达到最先进水平,并且在测试的大多数以往织物折叠方法上也取得相当性能,即使没有在织物专用数据集上进行显式训练(即零样本操纵)。此外,我们在 10 次抚平与 12 次折叠 rollout 的物理实验中应用 GPT-Fabric。结果表明,GPT-Fabric 是一种适用于高精度织物操纵任务的有前景方法。

英文摘要:

Fabric manipulation has applications in folding blankets, handling patient clothing, and protecting items with covers. It is challenging for robots to perform fabric manipulation since fabrics have infinite-dimensional configuration spaces, complex dynamics, and may be in folded or crumpled configurations with severe self-occlusions. Prior work on robotic fabric manipulation relies either on heavily engineered setups or learning-based approaches that create and train on robot-fabric interaction data. In this paper, we propose GPT-Fabric for the canonical tasks of fabric smoothing and folding, where GPT directly outputs an action informing a robot where to grasp and pull a fabric. We perform extensive experiments in simulation to test GPT-Fabric against prior methods for smoothing and folding. GPT-Fabric matches the state-of-the-art in fabric smoothing, and also achieves comparable performance with most prior fabric folding methods tested, even without explicitly training on a fabric-specific dataset (i.e., zero-shot manipulation). Furthermore, we apply GPT-Fabric in physical experiments over 10 smoothing and 12 folding rollouts. Our results suggest that GPT-Fabric is a promising approach for high-precision fabric manipulation tasks

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑