It is a big problem that a model of deep learning for a picking robot needs many labeled images. Operating costs of retraining a model becomes very expensive because the object shape of a product or a part often is changed in a factory. It is important to reduce the amount of labeled images required to train a model for a picking robot. In this study, we propose a multi-task learning framework for few-shot classification using feature vectors from an intermediate layer of a model that detects grasping positions. In the field of manufacturing, multitask for shape classification and grasping-position detection is often required for picking robots. Prior multi-task learning studies include methods to learn one task with feature vectors from a deep neural network (DNN) learned for another task. However, the DNN that was used to detect grasping positions has two problems with respect to extracting feature vectors from a layer for shape classification: (1) Because each layer of the grasping position detection DNN is activated by all objects in the input image, it is necessary to refine the features for each grasping position. (2) It is necessary to select a layer to extract the features suitable for shape classification. To tackle these issues, we propose a method to refine the features for each grasping position and to select features from the optimal layer of the DNN. We then evaluated the shape classification accuracy using these features from the grasping positions. Our results confirm that our proposed framework can classify object shapes even when the input image includes multiple objects and the number of images available for training is small.
SegGrasp: Zero-Shot Task-Oriented Grasping via Semantic and Geometric Guided Segmentation
Institute of Software, Chinese Academy of Sciences(中国科学院软件研究所);University of Hong Kong(香港大学);Zhejiang University(浙江大学);MEGVII Technology(旷视科技);Waseda University(早稻田大学)
Grasping in the Dark: Zero-Shot Object Grasping Using Tactile Feedback
Perception and Robotics Group, University of Maryland, College Park(马里兰大学帕克分校感知与机器人小组);University of Maryland, College Park(马里兰大学帕克分校);University of Maryland(马里兰大学)
TD-TOG Dataset: Benchmarking Zero-Shot and One-Shot Task-Oriented Grasping for Object Generalization
University of Aberdeen(阿伯丁大学);Bank of Valletta(瓦莱塔银行);Universite Claude Bernard Lyon 1(里昂第一大学);CNRS(法国国家科学研究中心);École Centrale de Lyon(里昂中央理工学院);INSA Lyon(里昂国立应用科学学院);Université Lumière Lyon 2(里昂第二大学);Technical University of Applied Sciences Würzburg-Schweinfurt(维尔茨堡-施韦因富特应用技术大学)
Grasping, Part Identification, and Pose Refinement in One Shot with a Tactile Gripper
HP-NTU Digital Manufacturing Corporate Lab(惠普-南洋理工大学数字制造企业实验室);School of Mechanical and Aerospace Engineering, Nanyang Technological University(南洋理工大学机械与航空航天工程学院)
ClutterDexGrasp: A Sim-to-Real System for General Dexterous Grasping in Cluttered Scenes
CFCS, School of Computer Science, Peking University(计算机学院,北京大学);PKU-AgiBot Lab(北京大学阿吉机器人实验室);PKU-PsiBot Lab(北京大学Psi机器人实验室);Princeton University(普林斯顿大学)
Visual-tactile Fusion for Transparent Object Grasping in Complex Backgrounds
Tsinghua Shenzhen International Graduate School(清华大学深圳国际研究生院);RISC-V International Open Source Laboratory(RISC-V国际开源实验室);Tsinghua-Berkeley Shenzhen Institute(清华-伯克利深圳学院);Institute of Artificial Intelligence, Collaborative Innovation Center for the Marine Artificial Intelligence, Shanghai University(上海大学人工智能学院、海洋人工智能协同创新中心)
UltraDexGrasp: Learning Universal Dexterous Grasping for Bimanual Robots with Synthetic Data
Shanghai AI Laboratory(上海人工智能实验室);The Chinese University of Hong Kong(香港中文大学);Zhejiang University(浙江大学);The University of Hong Kong(香港大学);Peking University(北京大学)
Lan-grasp: Using Large Language Models for Semantic Object Grasping and Placement
Department of Computer Science and Artificial Intelligence, University of Technology Nuremberg(计算机科学与人工智能系,图恩技术大学);Department of Engineering ``Enzo Ferrari'' (DIEF), University of Modena and Reggio Emilia(恩佐·费尔拉蒂工程系(DIEF),摩德纳和雷吉奥艾米利亚大学);Technical University of Munich(慕尼黑技术大学)
Graduate School of Engineering Science, Osaka University(大阪大学工程科学研究生院);Graduate School of Engineering, Osaka University(大阪大学工程研究生院);National Institute of Advanced Industrial Science and Technology(独立行政法人产业技术综合研究所)