Efficient Heatmap-Guided 6-Dof Grasp Detection in Cluttered Scenes
Tsinghua University(清华大学);Shanghai AI Laboratory(上海人工智能实验室);Beijing National Research Center for Information Science and Technology (BNRist)(北京信息科学与技术国家研究中心)
Siang Chen, Wei Tang, Pengwei Xie, Wenming Yang, Guijin Wang
Fast and robust object grasping in clutter is a crucial component of robotics. Most current works resort to the whole observed point cloud for 6-Dof grasp generation, ignoring the guidance information excavated from global semantics, thus limiting high-quality grasp generation and real-time performance. In this work, we show that the widely used heatmaps are underestimated in the efficiency of 6-Dof grasp generation. Therefore, we propose an effective local grasp generator combined with grasp heatmaps as guidance, which infers in a global-to-local semantic-to-point way. Specifically, Gaussian encoding and the grid-based strategy are applied to predict grasp heatmaps as guidance to aggregate local points into graspable regions and provide global semantic information. Further, a novel non-uniform anchor sampling mechanism is designed to improve grasp accuracy and diversity. Benefiting from the high-efficiency encoding in the image space and focusing on points in local graspable regions, our framework can perform high-quality grasp detection in real-time and achieve state-of-the-art results. In addition, real robot experiments demonstrate the effectiveness of our method with a success rate of 94% and a clutter completion rate of 100%. Our code is available at https://github.com/THU-VCLab/HGGD.
TANGO: Humanoid Navigation in Cluttered Environments with a Whole-Body Vision-Language-Action Model
University of California, Berkeley(加州大学伯克利分校);Peking University(北京大学);Tsinghua University(清华大学);The University of Hong Kong(香港大学);Princeton University(普林斯顿大学)
P$^2$GNet: Pose-Guided Point Cloud Generating Networks for 6-DoF Object Pose Estimation
Tsinghua University(清华大学);State Key Lab of Intelligent Technologies and Systems(智能技术与系统国家重点实验室);Beijing National Research Center for Information Science and Technology(北京信息科学与技术国家研究中心)
ASGrasp: Generalizable Transparent Object Reconstruction and 6-DoF Grasp Detection from RGB-D Active Stereo Camera
Samsung R&D Institute China-Beijing(三星中国北京研发中心);CFCS, School of Computer Science, Peking University(计算机科学系,北京大学);Beijing Academy of Artificial Intelligence (BAAI)(北京人工智能研究院)
Simultaneous Semantic and Collision Learning for 6-DoF Grasp Pose Estimation
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Bytedance AI Lab(字节跳动人工智能实验室);The Chinese University of Hong Kong(香港中文大学)
Learning 6-DoF Task-oriented Grasp Detection via Implicit Estimation and Visual Affordance
Universität Hamburg(汉堡大学);Agile Robots AG(敏捷机器人公司);Beijing National Research Center for Information Science and Technology(北京信息科学与技术国家研究中心);Tsinghua University(清华大学)
Language-Driven 6-DoF Grasp Detection Using Negative Prompt Guidance
FPT Software AI Center(FPT软件AI中心);TU Wien(维也纳技术大学);AIT GmbH(AIT有限公司);Imperial College London(伦敦帝国学院);Physical Intelligence(物理智能公司);University of Arkansas(阿肯色大学);Ton Duc Thang University(同塔大学);University of Liverpool(利物浦大学)
Region-aware Grasp Framework with Normalized Grasp Space for Efficient 6-DoF Grasping
Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);Department of Electronic Engineering, Tsinghua University(清华大学电子工程系);Shanghai AI Laboratory(上海人工智能实验室)
Generalizing 6-DoF Grasp Detection via Domain Prior Knowledge
State Key Laboratory of Software Development Environment, Beihang University(北京航空航天大学软件开发环境国家重点实验室);School of Computer Science and Engineering, Beihang University(北京航空航天大学计算机科学与工程学院);School of Computer Science and Technology, Harbin Institute of Technology(哈尔滨工业大学计算机科学与技术学院)
Volumetric-based Contact Point Detection for 7-DoF Grasping
The Hong Kong University of Science and Technology(香港科技大学);HKUST Shenzhen-Hong Kong Collaborative Innovation Research Institute(香港科技大学深港协同创新研究院);Sun Yat-sen University(中山大学);Monash University(莫纳什大学)
GPR: Grasp Pose Refinement Network for Cluttered Scenes
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);CAS Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences(中国科学院脑科学与智能技术卓越创新中心)