Recent advances have been made in learning of grasps for fully actuated hands. A typical approach learns the target locations of finger links on the object. When a new object must be grasped, new finger locations are generated, and a collision free reach-to-grasp trajectory is planned. This assumes a collision free trajectory to the final grasp. This is not possible with underactuated hands, which cannot be guaranteed to avoid contact, and in fact exploit contacts with the object during grasping, so as to reach an equilibrium state in which the object is held securely. Unfortunately, these contact interactions are i) not directly controllable, and ii) hard to monitor during a real grasp. We overcome these problems so as to permit learning of transferrable grasps for underactuated hands. We make two main technical innovations. First, we model contact interactions during the grasp implicitly. We do this by modelling motor commands that lead reliably to the equilibrium state, rather than modelling contact changes themselves. This alters our reach-to-grasp model. Second, we extend our contact model learning algorithm to work with multiple training examples for each grasp type. This requires the ability to learn which parts of the hand reliably interact with the object during a particular grasp. Our approach learns from a rigid body simulation. This enables us to learn how to approach the object and close the underactuated hand from a variety of poses. From nine training grasps on three objects the method transferred grasps to previously unseen, novel objects, that differ significantly from the training objects, with an 80% success rate.
Grasp as You Say: Language-guided Dexterous Grasp Generation
School of Computer Science and Engineering, Sun Yat-sen University(中山大学计算机科学与工程学院);Stanford University(斯坦福大学);Key Laboratory of Machine Intelligence and Advanced Computing, Ministry of Education, China(教育部机器智能与高级计算重点实验室)
Underactuated Robotic Hand with Grasp State Estimation Using Tendon-Based Proprioception
BioRobotics Laboratory (BRL), Soft Robotics Research Center (SRRC), Institute of Advanced Machines and Design (IAMD), Department of Mechanical Engineering, Institute of Engineering, Seoul National University (SNU)(生物机器人实验室(BRL)、软机器人研究中心(SRRC)、先进机械与设计研究所(IAMD)、机械工程系、工程学院、首尔国立大学(SNU))
T(R,O) Grasp: Efficient Graph Diffusion of Robot-Object Spatial Transformation for Cross-Embodiment Dexterous Grasping
Department of Computer Science, National University of Singapore(新加坡国立大学计算机科学系);RoboScience;College of Control Science and Engineering, Zhejiang University(浙江大学控制科学与工程学院)
AffordDexGrasp: Open-set Language-guided Dexterous Grasp with Generalizable-Instructive Affordance
School of Computer Science and Engineering, Sun Yat-sen University, China(中山大学计算机科学与工程学院);Key Laboratory of Machine Intelligence and Advanced Computing, Ministry of Education, China(教育部人工智能与高级计算重点实验室)
School of Computer Science and Engineering, Sun Yat-sen University(中山大学计算机科学与工程学院);Key Laboratory of Machine Intelligence and Advanced Computing, Ministry of Education, China(教育部机器智能与先进计算重点实验室)
BiDexGrasp: Coordinated Bimanual Dexterous Grasps across Object Geometries and Sizes
School of Computer Science and Engineering, Sun Yat-sen University(中山大学计算机科学与工程学院);School of Computer Science, Peking University(北京大学计算机学院);Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院)
CADGrasp: Learning Contact and Collision Aware General Dexterous Grasping in Cluttered Scenes
Center on Frontiers of Computing Studies, School of Computer Science, Peking University(前沿计算研究中心,计算机学院,北京大学);National Key Laboratory for Multimedia Information Processing, School of Computer Science, Peking University(多媒体信息处理国家级重点实验室,计算机学院,北京大学)
PartDexTOG: Generating Dexterous Task-Oriented Grasping via Language-driven Part Analysis
College of Computer Science and Technology, National University of Defense Technology(计算机科学与技术学院,国防科技大学);College of Intelligence Science and Technology, National University of Defense Technology(智能科学与技术学院,国防科技大学)
SynManDex: Synthesizing Human-like Dexterous Grasps from Synthetic Human Pre-Grasps
Shanghai AI Lab(上海人工智能实验室);Shanghai Jiaotong University(上海交通大学);Shenzhen University(深圳大学);Fudan University(复旦大学);University of Hong Kong(香港大学);ZTE Corporation(中兴通讯股份有限公司)
UltraDexGrasp: Learning Universal Dexterous Grasping for Bimanual Robots with Synthetic Data
Shanghai AI Laboratory(上海人工智能实验室);The Chinese University of Hong Kong(香港中文大学);Zhejiang University(浙江大学);The University of Hong Kong(香港大学);Peking University(北京大学)
DexTOG: Learning Task-Oriented Dexterous Grasp with Language
School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University(上海交通大学电子信息与电气工程学院);AI Institute, Shanghai Jiao Tong University(上海交通大学AI研究院);Southeast University(东南大学)
DexRepNet: Learning Dexterous Robotic Grasping Network with Geometric and Spatial Hand-Object Representations
College of Control Science and Engineering, Zhejiang University(浙江大学控制科学与工程学院);Key Lab of CS&AUS of Zhejiang Province(浙江省计算机与应用系统安全重点实验室);Department of Computer Science, National University of Singapore(新加坡国立大学计算机科学系)
$\mathcal{D(R,O)}$ Grasp: A Unified Representation of Robot and Object Interaction for Cross-Embodiment Dexterous Grasping
National University of Singapore(新加坡国立大学);School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University(上海交通大学电子信息与电气工程学院);Zhiyuan College, Shanghai Jiao Tong University(上海交通大学致远学院)