We use static object data to improve success detection for stacking objects on and nesting objects in one another. Such actions are necessary for certain robotics tasks, e.g., clearing a dining table or packing a warehouse bin. However, using an RGB-D camera to detect success can be insufficient: same-colored objects can be difficult to differentiate, and reflective silverware cause noisy depth camera perception. We show that adding static data about the objects themselves improves the performance of an end-to-end pipeline for classifying action outcomes. Images of the objects, and language expressions describing them, encode prior geometry, shape, and size information that refine classification accuracy. We collect over 13 hours of egocentric manipulation data for training a model to reason about whether a robot successfully placed unseen objects in or on one another. The model achieves up to a 57% absolute gain over the task baseline on pairs of previously unseen objects.
HiRT: Enhancing Robotic Control with Hierarchical Robot Transformers
Institute for Interdisciplinary Information Sciences, Tsinghua University(清华大学交叉信息研究院);University of California, Berkeley(加利福尼亚大学伯克利分校);Shanghai Qizhi Institute(上海智知研究院)
Chair for Computer-Aided Medical Procedures and Augmented Reality, Technical University of Munich(计算机辅助医学程序与增强现实 chair,慕尼黑技术大学);Munich Center for Machine Learning(慕尼黑机器学习中心);The University of Hong Kong(香港大学)
Inverse Statics Optimization for Compound Tensegrity Robots
Department of Mechanical Engineering, University of California Berkeley(加州大学伯克利分校机械工程系);Intelligent Systems Division, NASA Ames Research Center(NASA阿姆斯研究中心智能系统部)
LLM-Driven Corrective Robot Operation Code Generation with Static Text-Based Simulation
Department of CIS, University of Massachusetts Dartmouth(大学马萨诸塞州达特茅斯分校计算机信息科学系);Department of CSIS, California State University San Marcos(加州州立大学桑马科斯分校计算机科学与信息系统系)
Quasi-Static Analysis on Transoral Surgical Tendon-Driven Articulated Robot Units
Georgia Institute of Technology(佐治亚理工学院);Asan Medical Center(峨山医院);Asan Institute for Life Sciences(峨山生命科学研究所);University of Ulsan College of Medicine(蔚山大学医学院)
Adaptive vs. Static Robot-to-Human Handover: A Study on Orientation and Approach Direction
Department of Engineering "Enzo Ferrari", University of Modena and Reggio Emilia(工程学院"Enzo Ferrari",摩德纳和雷吉奥艾米利亚大学);Department of Surgery, Medicine, Dentistry and Morphological Sciences, University of Modena and Reggio Emilia(外科、医学、牙科和形态学科学学院,摩德纳和雷吉奥艾米利亚大学)
Multi-robot searching with limited sensing range for static and mobile intruders
Department of Electrical Engineering and Computer Science(电气工程与计算机科学系);Indian Institute of Science Education and Research, Bhopal, India(印度科学教育与研究学院,布里帕尔,印度);Department of Computer Science(计算机科学系);Indian Institute of Technology, Mumbai, India(印度理工学院,孟买,印度);Department of Applied Mathematics and Statistics(应用数学与统计学系);Stony Brook University, United States(石溪大学,美国);Nirma University, Ahmedabad, India(尼尔马大学,艾哈迈德abad,印度)
Accelerated Quasi-Static FEM for Real-Time Modeling of Continuum Robots with Multiple Contacts and Large Deformation
School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Centre of AI and Robotics (CAIR), Hong Kong Institute of Science Innovation, Chinese Academy of Sciences(中国科学院香港创新研究院人工智能与机器人中心)
Socially-aware Object Transportation by a Mobile Manipulator in Static Planar Environments with Obstacles
Computer Vision and Robotics Laboratory (VeRLab), Department of Computer Science, Universidade Federal de Minas Gerais(计算机视觉与机器人实验室(VeRLab)、计算机科学系、巴西矿务大学)
Robotic Task Success Evaluation Under Multi-modal Non-Parametric Object Pose Uncertainty
University of Southern Denmark(南丹麦大学);SDU Robotics(SDU机器人学(注:SDU为南丹麦大学缩写));Mærsk Mc-Kinney Møller Institute (MMMI)(马士基麦金姆穆勒研究所);Faculty of Engineering(工程学院);Danish Institute for Advanced Studies (DIAS)(丹麦高级研究院)
COFFAIL: A Dataset of Successful and Anomalous Robot Skill Executions in the Context of Coffee Preparation
Division of Systems and Control, Chalmers University of Technology(系统与控制系,楚姆勒斯理工大学);Bonn-Rhein-Sieg University of Applied Sciences(波恩-莱茵-西弗大学);Autonomous Systems Group, Bonn-Rhein-Sieg University of Applied Sciences(自主系统组,波恩-莱茵-西弗大学)
School of Mechanical and Aerospace Engineering, NTU(南洋理工大学机械与宇航工程学院);Laboratoire d’Informatique, de Robotique et de Microélectronique de Montpellier (LIRMM), CNRS / Université de Montpellier(蒙彼利埃计算机、机器人与微电子实验室(LIRMM),法国国家科学研究中心/蒙彼利埃大学);Department of Mechano-Informatics, University of Tokyo(东京大学机械信息学系)