We introduce a new approach for robotic manipulation tasks in human settings that necessitates understanding the 3D geometric connections between a pair of objects. Conventional end-to-end training approaches, which convert pixel observations directly into robot actions, often fail to effectively understand complex pose relationships and do not easily adapt to new object configurations. To overcome these issues, our method focuses on learning the 3D geometric relationships, particularly how critical parts of one object relate to those of another. We employ Weighted SVD in our standalone model to analyze pose relationships both in articulated parts and in free-floating objects. For instance, our model can comprehend the spatial relationship between an oven door and the oven body, as well as between a lasagna plate and the oven. By concentrating on the 3D geometric connections, our strategy empowers robots to carry out intricate manipulation tasks based on object-centric perspectives
FUNCanon: Learning Pose-Aware Action Primitives via Functional Object Canonicalization for Generalizable Robotic Manipulation
TAMS (Technical Aspects of Multimodal Systems), Department of Informatics, University of Hamburg(汉堡大学信息学院TAMS(多模态系统技术));Technical University of Munich(慕尼黑技术大学);Agile Robots SE(敏捷机器人有限公司)
Generalizable 6D Pose Estimation of Textureless Objects with Planar-based Gaussian Splatting
College of Future Information Technology, Fudan University(复旦大学未来信息技术学院);College of Intelligent Robotics and Advanced Manufacturing, Fudan University(复旦大学智能机器人与先进制造学院);University of Turku(图尔库大学);Jihua Laboratory(季华实验室)
Enhancing Generalizable 6D Pose Tracking of an In-Hand Object with Tactile Sensing
Institute for Interdisciplinary Information Sciences, Tsinghua University(清华大学交叉信息研究院);Shanghai Qizhi Institute(上海期智研究院);Department of Mechanical Engineering, Tsinghua University(清华大学机械工程系);Northwestern Polytechnical University(西北工业大学);Center on Frontiers of Computing Studies, Peking University(北京大学计算与前沿研究中心);Shanghai AI Laboratory(上海人工智能实验室)
Uni-PNP: Unified Prehensile and Non-prehensile Policy Learning for Generalizable Object Pose Reaching
Peking University(北京大学);Galbot;Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Beijing Academy of Artificial Intelligence(北京人工智能研究院);Tsinghua University(清华大学)
Universal Pose Pretraining for Generalizable Vision-Language-Action Policies
Tencent Robotics X(腾讯机器人X);Futian Laboratory(福田实验室);The Hong Kong University of Science and Technology(香港科学与技术大学);Fudan University(复旦大学);Shanghai Innovation Institute(上海创新研究院)
UltraDP: Generalizable Carotid Ultrasound Scanning with Force-Aware Diffusion Policy
Department of Automation, Tsinghua University(自动化系,清华大学);Department of Surgery, Chow Yuk Ho Technology Centre for Innovative Medicine, Li Ka Shing Institute of Health Science and Multi-scale Medical Robotics Center, The Chinese University of Hong Kong, Hong Kong(外科系,创新医学技术中心,利文斯科健康科学研究所及多尺度医学机器人中心,香港中文大学,香港)
Trajectory-based Diffusion from One-shot Human Video for Generalizable Manipulation
Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);Zerith Robotics(智臻机器人);University of Science and Technology of China(中国科学技术大学)
G3Flow: Generative 3D Semantic Flow for Pose-aware and Generalizable Object Manipulation
The University of Hong Kong(香港大学);Institute of Artificial Intelligence (TeleAI), China Telecom(人工智能研究所(TeleAI),中国电信);Shenzhen University(深圳大学);AgileX Robotics(AgileX机器人);GDIIST;HKU Shanghai Intelligent Computing Research Center(香港大学上海智能计算研究中心)
Human Demonstrations are Generalizable Knowledge for Robots
School of Automation, Beijing Institute of Technology, Beijing, 100081, China(自动化学院,北京理工大学,北京,100081,中国);Beijing Zhongguancun Academy, Beijing, 100094, China(中关村学院,北京,100094,中国)
Learning Generalizable 3D Manipulation With 10 Demonstrations
State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences(中国科学院沈阳自动化研究所 机器人学国家重点实验室);University of Chinese Academy of Sciences(中国科学院大学);College of Automation Science and Engineering, South China University of Technology(华南理工大学自动化科学与工程学院)