Dexterous grasp generation is a fundamental challenge in robotics, requiring both grasp stability and adaptability across diverse objects and tasks. Analytical methods ensure stable grasps but are inefficient and lack task adaptability, while generative approaches improve efficiency and task integration but generalize poorly to unseen objects and tasks due to data limitations. In this paper, we propose a transfer-based framework for dexterous grasp generation, leveraging a conditional diffusion model to transfer high-quality grasps from shape templates to novel objects within the same category. Specifically, we reformulate the grasp transfer problem as the generation of an object contact map, incorporating object shape similarity and task specifications into the diffusion process. To handle complex shape variations, we introduce a dual mapping mechanism, capturing intricate geometric relationship between shape templates and novel objects. Beyond the contact map, we derive two additional object-centric maps, the part map and direction map, to encode finer contact details for more stable grasps. We then develop a cascaded conditional diffusion model framework to jointly transfer these three maps, ensuring their intra-consistency. Finally, we introduce a robust grasp recovery mechanism, identifying reliable contact points and optimizing grasp configurations efficiently. Extensive experiments demonstrate the superiority of our proposed method. Our approach effectively balances grasp quality, generation efficiency, and generalization performance across various tasks. Project homepage: https://cmtdiffusion.github.io/
Grasp as You Say: Language-guided Dexterous Grasp Generation
School of Computer Science and Engineering, Sun Yat-sen University(中山大学计算机科学与工程学院);Stanford University(斯坦福大学);Key Laboratory of Machine Intelligence and Advanced Computing, Ministry of Education, China(教育部机器智能与高级计算重点实验室)
T(R,O) Grasp: Efficient Graph Diffusion of Robot-Object Spatial Transformation for Cross-Embodiment Dexterous Grasping
Department of Computer Science, National University of Singapore(新加坡国立大学计算机科学系);RoboScience;College of Control Science and Engineering, Zhejiang University(浙江大学控制科学与工程学院)
AffordDexGrasp: Open-set Language-guided Dexterous Grasp with Generalizable-Instructive Affordance
School of Computer Science and Engineering, Sun Yat-sen University, China(中山大学计算机科学与工程学院);Key Laboratory of Machine Intelligence and Advanced Computing, Ministry of Education, China(教育部人工智能与高级计算重点实验室)
School of Computer Science and Engineering, Sun Yat-sen University(中山大学计算机科学与工程学院);Key Laboratory of Machine Intelligence and Advanced Computing, Ministry of Education, China(教育部机器智能与先进计算重点实验室)
BiDexGrasp: Coordinated Bimanual Dexterous Grasps across Object Geometries and Sizes
School of Computer Science and Engineering, Sun Yat-sen University(中山大学计算机科学与工程学院);School of Computer Science, Peking University(北京大学计算机学院);Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院)
CADGrasp: Learning Contact and Collision Aware General Dexterous Grasping in Cluttered Scenes
Center on Frontiers of Computing Studies, School of Computer Science, Peking University(前沿计算研究中心,计算机学院,北京大学);National Key Laboratory for Multimedia Information Processing, School of Computer Science, Peking University(多媒体信息处理国家级重点实验室,计算机学院,北京大学)
PartDexTOG: Generating Dexterous Task-Oriented Grasping via Language-driven Part Analysis
College of Computer Science and Technology, National University of Defense Technology(计算机科学与技术学院,国防科技大学);College of Intelligence Science and Technology, National University of Defense Technology(智能科学与技术学院,国防科技大学)
SynManDex: Synthesizing Human-like Dexterous Grasps from Synthetic Human Pre-Grasps
Shanghai AI Lab(上海人工智能实验室);Shanghai Jiaotong University(上海交通大学);Shenzhen University(深圳大学);Fudan University(复旦大学);University of Hong Kong(香港大学);ZTE Corporation(中兴通讯股份有限公司)
UltraDexGrasp: Learning Universal Dexterous Grasping for Bimanual Robots with Synthetic Data
Shanghai AI Laboratory(上海人工智能实验室);The Chinese University of Hong Kong(香港中文大学);Zhejiang University(浙江大学);The University of Hong Kong(香港大学);Peking University(北京大学)
DexTOG: Learning Task-Oriented Dexterous Grasp with Language
School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University(上海交通大学电子信息与电气工程学院);AI Institute, Shanghai Jiao Tong University(上海交通大学AI研究院);Southeast University(东南大学)
DexRepNet: Learning Dexterous Robotic Grasping Network with Geometric and Spatial Hand-Object Representations
College of Control Science and Engineering, Zhejiang University(浙江大学控制科学与工程学院);Key Lab of CS&AUS of Zhejiang Province(浙江省计算机与应用系统安全重点实验室);Department of Computer Science, National University of Singapore(新加坡国立大学计算机科学系)
$\mathcal{D(R,O)}$ Grasp: A Unified Representation of Robot and Object Interaction for Cross-Embodiment Dexterous Grasping
National University of Singapore(新加坡国立大学);School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University(上海交通大学电子信息与电气工程学院);Zhiyuan College, Shanghai Jiao Tong University(上海交通大学致远学院)
ClutterDexGrasp: A Sim-to-Real System for General Dexterous Grasping in Cluttered Scenes
CFCS, School of Computer Science, Peking University(计算机学院,北京大学);PKU-AgiBot Lab(北京大学阿吉机器人实验室);PKU-PsiBot Lab(北京大学Psi机器人实验室);Princeton University(普林斯顿大学)