Dexterous grasping is fundamental to robotics, yet data-driven grasp prediction heavily relies on large, diverse datasets that are costly to generate and typically limited to a narrow set of gripper morphologies. Analytical grasp synthesis can be used to scale data collection, but necessary simplifying assumptions often yield physically infeasible grasps that need to be filtered in high-fidelity simulators, significantly reducing the total number of grasps and their diversity.
We propose a scalable generate-and-refine pipeline for synthesizing large-scale, diverse, and physically feasible grasps. Instead of using high-fidelity simulators solely for verification and filtering, we leverage them as an optimization stage that continuously improves grasp quality without discarding precomputed candidates. More specifically, we initialize an evolutionary search with a seed set of analytically generated, potentially suboptimal grasps. We then refine these proposals directly in a high-fidelity simulator (Isaac Sim) using an asynchronous, gradient-free evolutionary algorithm, improving stability while maintaining diversity. In addition, this refinement stage can be guided toward human preferences and/or domain-specific quality metrics without requiring a differentiable objective. We further distill the refined grasp distribution into a diffusion model for robust real-world deployment, and highlight the role of diversity for both effective training and during deployment. Experiments on a newly introduced Handles dataset and a DexGraspNet subset demonstrate that our approach achieves over 120 distinct stable grasps per object (a 1.7-6x improvement over unrefined analytical methods) while outperforming diffusion-based alternatives by 46-60\% in unique grasp coverage.
Grasp as You Say: Language-guided Dexterous Grasp Generation
School of Computer Science and Engineering, Sun Yat-sen University(中山大学计算机科学与工程学院);Stanford University(斯坦福大学);Key Laboratory of Machine Intelligence and Advanced Computing, Ministry of Education, China(教育部机器智能与高级计算重点实验室)
BiDexGrasp: Coordinated Bimanual Dexterous Grasps across Object Geometries and Sizes
School of Computer Science and Engineering, Sun Yat-sen University(中山大学计算机科学与工程学院);School of Computer Science, Peking University(北京大学计算机学院);Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院)
UltraDexGrasp: Learning Universal Dexterous Grasping for Bimanual Robots with Synthetic Data
Shanghai AI Laboratory(上海人工智能实验室);The Chinese University of Hong Kong(香港中文大学);Zhejiang University(浙江大学);The University of Hong Kong(香港大学);Peking University(北京大学)
ClutterDexGrasp: A Sim-to-Real System for General Dexterous Grasping in Cluttered Scenes
CFCS, School of Computer Science, Peking University(计算机学院,北京大学);PKU-AgiBot Lab(北京大学阿吉机器人实验室);PKU-PsiBot Lab(北京大学Psi机器人实验室);Princeton University(普林斯顿大学)
MoDex: A Diffusion Policy for Sequential Multi-Object Dexterous Grasping
Department of Robotics, Perception and Learning, KTH Royal Institute of Technology(机器人、感知与学习系,皇家理工学院);Robotics and Autonomous Systems at University of Turku(图尔库大学机器人与自主系统)
Designing Pin-pression Gripper and Learning its Dexterous Grasping with Online In-hand Adjustment
Dalian University of Technology(大连理工大学);Wuhan University(武汉大学);Shenyang University of Technology(沈阳理工大学);National University of Defense Technology(国防科技大学)
D-REX: Differentiable Real-to-Sim-to-Real Engine for Learning Dexterous Grasping
Physical Superintelligence (PSI) Lab, University of Southern California(南加州大学物理超智能实验室);Viterbi School of Engineering, University of Southern California(南加州大学韦伯尔工程学院);Department of EECS, University of California, Berkeley(加州大学伯克利分校电子工程与计算机科学系)
T(R,O) Grasp: Efficient Graph Diffusion of Robot-Object Spatial Transformation for Cross-Embodiment Dexterous Grasping
Department of Computer Science, National University of Singapore(新加坡国立大学计算机科学系);RoboScience;College of Control Science and Engineering, Zhejiang University(浙江大学控制科学与工程学院)
AffordDexGrasp: Open-set Language-guided Dexterous Grasp with Generalizable-Instructive Affordance
School of Computer Science and Engineering, Sun Yat-sen University, China(中山大学计算机科学与工程学院);Key Laboratory of Machine Intelligence and Advanced Computing, Ministry of Education, China(教育部人工智能与高级计算重点实验室)
School of Computer Science and Engineering, Sun Yat-sen University(中山大学计算机科学与工程学院);Key Laboratory of Machine Intelligence and Advanced Computing, Ministry of Education, China(教育部机器智能与先进计算重点实验室)
CADGrasp: Learning Contact and Collision Aware General Dexterous Grasping in Cluttered Scenes
Center on Frontiers of Computing Studies, School of Computer Science, Peking University(前沿计算研究中心,计算机学院,北京大学);National Key Laboratory for Multimedia Information Processing, School of Computer Science, Peking University(多媒体信息处理国家级重点实验室,计算机学院,北京大学)
PartDexTOG: Generating Dexterous Task-Oriented Grasping via Language-driven Part Analysis
College of Computer Science and Technology, National University of Defense Technology(计算机科学与技术学院,国防科技大学);College of Intelligence Science and Technology, National University of Defense Technology(智能科学与技术学院,国防科技大学)
SynManDex: Synthesizing Human-like Dexterous Grasps from Synthetic Human Pre-Grasps
Shanghai AI Lab(上海人工智能实验室);Shanghai Jiaotong University(上海交通大学);Shenzhen University(深圳大学);Fudan University(复旦大学);University of Hong Kong(香港大学);ZTE Corporation(中兴通讯股份有限公司)
DexTOG: Learning Task-Oriented Dexterous Grasp with Language
School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University(上海交通大学电子信息与电气工程学院);AI Institute, Shanghai Jiao Tong University(上海交通大学AI研究院);Southeast University(东南大学)
DexRepNet: Learning Dexterous Robotic Grasping Network with Geometric and Spatial Hand-Object Representations
College of Control Science and Engineering, Zhejiang University(浙江大学控制科学与工程学院);Key Lab of CS&AUS of Zhejiang Province(浙江省计算机与应用系统安全重点实验室);Department of Computer Science, National University of Singapore(新加坡国立大学计算机科学系)