In this paper, we present a novel method for achieving dexterous manipulation of complex objects, while simultaneously securing the object without the use of passive support surfaces. We posit that a key difficulty for training such policies in a Reinforcement Learning framework is the difficulty of exploring the problem state space, as the accessible regions of this space form a complex structure along manifolds of a high-dimensional space. To address this challenge, we use two versions of the non-holonomic Rapidly-Exploring Random Trees algorithm; one version is more general, but requires explicit use of the environment's transition function, while the second version uses manipulation-specific kinematic constraints to attain better sample efficiency. In both cases, we use states found via sampling-based exploration to generate reset distributions that enable training control policies under full dynamic constraints via model-free Reinforcement Learning. We show that these policies are effective at manipulation problems of higher difficulty than previously shown, and also transfer effectively to real robots. Videos of the real-hand demonstrations can be found on the project website: https://sbrl.cs.columbia.edu/
TypeTele: Releasing Dexterity in Teleoperation by Dexterous Manipulation Types
School of Computer Science and Engineering, Sun Yat-sen University, China(中山大学计算机科学与工程学院);Stanford University, USA(斯坦福大学);Imperial College London, UK(伦敦帝国理工学院)
DexJoCo: A Benchmark and Toolkit for Task-Oriented Dexterous Manipulation on MuJoCo
NLPR & MAIS, CASIA(中国科学院南京自动化研究所与模式识别与人工智能实验室);SJTU(上海交通大学);MBZUAI(马克斯·普朗克研究所);Beijing Institute of Basic Medical Sciences(北京基础医学研究所);PKU & Galbot(北京大学与Galbot);CUHK(香港大学)
EaDex: A Cross-Embodiment Dexterous Manipulation Framework from Low-Cost Demonstrations
Faculty of Robot Science and Engineering, Northeastern University(机器人科学与工程学院,东北大学);Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(深圳先进技术研究所,中国科学院);School of Automation, Nanjing University of Information Science and Technology(自动化学院,南京信息科学技术大学)
A Dexterous and Compliant Gripper With Soft Hydraulic Actuation for Microgravity Manipulation
Aerospace Engineering Program, University of California, Berkeley(加州大学伯克利分校航空航天工程系);Department of Mechanical Engineering, University of California, Berkeley(加州大学伯克利分校机械工程系);Department of Mechanical Engineering, National University of Singapore(新加坡国立大学机械工程系)
FoLD: Force-Informed Learning for Dexterous Articulated Object Manipulation
University of Science and Technology of China(中国科学技术大学);Institute of AI for Industries, Chinese Academy of Sciences(中国科学院人工智能产业研究院);Shenzhen University(深圳大学)
Analyzing Key Objectives in Human-to-Robot Retargeting for Dexterous Manipulation
Department of Automation, Beijing National Research Center for Information Science and Technology, Tsinghua University, China(自动化系,信息科学与技术国家工程研究中心,清华大学)
RBO Hand 3 -- A Platform for Soft Dexterous Manipulation
Technische Universität Berlin(柏林工业大学)
我们提出了RBO手3,一个高度能力和多功能的拟人软手基于气动驱动。RBO Hand 3旨在实现灵巧的操作,促进对人类灵巧性的见解的转移,并作为广泛的现实世界实验的强大研究平台。它通过将许多程度的致动与固有顺应性相结合、复制人手的相关功能以及通过将坚固的部件组合在模块化设计中来实现这些设计目标。RBO Hand 3拥有16个独立的驱动自由度,实现了灵巧的对置拇指、双腔手指、驱动手掌以及展开手指的能力。在这项工作中,我们得出的设计目标,是基于实验与手的前辈,对人类的把握观察,并对灵巧的原则的见解。我们详细解释了RBO手3的设计功能如何实现这些目标,并通过展示其在Kapandji测试中获得最高分数的能力来评估手,以实现全面GRASP分类的所有33种抓握类型,复制常见的人类抓握策略,并执行灵巧的手操作。
Benchmarking Structured Policies and Policy Optimization for Real-World Dexterous Object Manipulation
Technical University of Darmstadt(达姆施塔特工业大学);University of Washington(华盛顿大学);Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所);Cornell University(康奈尔大学);Toyota Technological Institute at Chicago(芝加哥丰田技术研究所)
Dexterous Soft Hands Linearize Feedback-Control for In-Hand Manipulation
Robotics and Biology Laboratory, Technische Universität Berlin(柏林工业大学机器人与生物实验室);Science of Intelligence, Research Cluster of Excellence, Berlin(柏林卓越研究集群智能科学)