arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2511.01276cs.RO
收藏

基于条件扩散模型的接触图迁移用于可泛化灵巧抓取生成

Contact Map Transfer with Conditional Diffusion Model for Generalizable Dexterous Grasp Generation

Department of Computer Science and Engineering, The Chinese University of Hong Kong(计算机科学与工程系,香港中文大学)

Yiyao Ma, Kai Chen, Kexin Zheng, Qi Dou

AI总结:

本文提出一种基于条件扩散模型的抓取迁移框架,通过生成接触图、部件图和方向图实现形状模板到新物体的高质量抓取迁移,有效平衡了抓取质量、生成效率和泛化性能。

摘要:

灵巧抓取生成是机器人学中的一个基本挑战,要求在多样物体和任务中兼具抓取稳定性和适应性。分析方法能确保稳定抓取但效率低下且缺乏任务适应性,而生成方法提高了效率与任务集成度,但由于数据限制,对未见物体和任务的泛化能力较差。本文提出了一个基于迁移的灵巧抓取生成框架,利用条件扩散模型将高质量抓取从形状模板迁移到同类别的全新物体上。具体而言,我们将抓取迁移问题重新表述为物体接触图的生成,将物体形状相似性和任务规范纳入扩散过程。为处理复杂的形状变化,我们引入了双重映射机制,捕捉形状模板与全新物体间复杂的几何关系。除接触图外,我们还推导出两个额外的以物体为中心的图,即部件图和方向图,以编码更精细的接触细节,从而实现更稳定的抓取。随后,我们开发了一个级联条件扩散模型框架,联合迁移这三个图,确保它们的内部一致性。最后,我们引入了鲁棒的抓取恢复机制,识别可靠的接触点并高效优化抓取配置。大量实验证明了所提方法的优越性。我们的方法在各种任务中有效平衡了抓取质量、生成效率和泛化性能。项目主页:https://cmtdiffusion.github.io/

英文摘要:

Dexterous grasp generation is a fundamental challenge in robotics, requiring both grasp stability and adaptability across diverse objects and tasks. Analytical methods ensure stable grasps but are inefficient and lack task adaptability, while generative approaches improve efficiency and task integration but generalize poorly to unseen objects and tasks due to data limitations. In this paper, we propose a transfer-based framework for dexterous grasp generation, leveraging a conditional diffusion model to transfer high-quality grasps from shape templates to novel objects within the same category. Specifically, we reformulate the grasp transfer problem as the generation of an object contact map, incorporating object shape similarity and task specifications into the diffusion process. To handle complex shape variations, we introduce a dual mapping mechanism, capturing intricate geometric relationship between shape templates and novel objects. Beyond the contact map, we derive two additional object-centric maps, the part map and direction map, to encode finer contact details for more stable grasps. We then develop a cascaded conditional diffusion model framework to jointly transfer these three maps, ensuring their intra-consistency. Finally, we introduce a robust grasp recovery mechanism, identifying reliable contact points and optimizing grasp configurations efficiently. Extensive experiments demonstrate the superiority of our proposed method. Our approach effectively balances grasp quality, generation efficiency, and generalization performance across various tasks. Project homepage: https://cmtdiffusion.github.io/

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑