Autonomous Motion Dept. at the MPI for Intelligent Systems(马克斯·普朗克智能系统研究所自主运动部门);Lula Robotics Inc.(Lula Robotics 公司);CLMC lab at the Univ. of Southern California(南加州大学 CLMC 实验室);Dept. of Computer Science & Engineering, Univ. of Washington(华盛顿大学计算机科学与工程系);Univ. of Stuttgart(斯图加特大学);Dept. of Computer Science, Stanford Univ.(斯坦福大学计算机科学系)
Daniel Kappler, Franziska Meier, Jan Issac, Jim Mainprice, Cristina Garcia Cifuentes, Manuel Wüthrich, Vincent Berenz, Stefan Schaal, Nathan Ratliff, Jeannette Bohg
We address the challenging problem of robotic grasping and manipulation in the presence of uncertainty. This uncertainty is due to noisy sensing, inaccurate models and hard-to-predict environment dynamics. We quantify the importance of continuous, real-time perception and its tight integration with reactive motion generation methods in dynamic manipulation scenarios. We compare three different systems that are instantiations of the most common architectures in the field: (i) a traditional sense-plan-act approach that is still widely used, (ii) a myopic controller that only reacts to local environment dynamics and (iii) a reactive planner that integrates feedback control and motion optimization. All architectures rely on the same components for real-time perception and reactive motion generation to allow a quantitative evaluation. We extensively evaluate the systems on a real robotic platform in four scenarios that exhibit either a challenging workspace geometry or a dynamic environment. In 333 experiments, we quantify the robustness and accuracy that is due to integrating real-time feedback at different time scales in a reactive motion generation system. We also report on the lessons learned for system building.
Reactive Motion Generation With Particle-Based Perception in Dynamic Environments
State Key Laboratory of Digital Medical Engineering(数字医疗工程国家重点实验室);Jiangsu Key Lab of Robot Sensing and Control(江苏省机器人感知与控制重点实验室);School of Instrument Science and Engineering(仪器科学与工程学院);Southeast University(东南大学)
No Plan, Yet Human: A Reactive Robotics Model Predicts Human Planning Failures on a Clinical Task
Robotics and Biology Laboratory, Technische Universität Berlin, Germany(技术大学柏林机器人与生物学实验室,德国);Science of Intelligence, Research Cluster of Excellence, Berlin, Germany(智能科学,卓越研究集群,柏林,德国);Robotics Institute Germany(德国机器人研究所)
G-MAPP: GPU-accelerated Multi-Agent Planning and Perception for Reactive Motion Generation
Department of Electrical, Computer, and Biomedical Engineering, Toronto Metropolitan University(多伦多都会大学电气、计算机与生物医学工程系);Munich Institute of Robotics and Machine Intelligence (MIRMI), Technical University of Munich (TUM)(慕尼黑工业大学慕尼黑机器人与机器智能研究所);Institute for Experiential Robotics, Northeastern University(东北大学体验式机器人研究所);Idiap Research Institute(Idiap 研究所);EPFL(瑞士联邦理工学院洛桑);CHART Group at the School of Computer Science, University of Nottingham(诺丁汉大学计算机科学学院 CHART 小组);Mohamed bin Zayed University of Artificial Intelligence (MBZUAI)(穆罕默德·本·扎耶德人工智能大学)
Beyond Domain Randomization: Event-Inspired Perception for Visually Robust Adversarial Imitation from Videos
Mercedes-Benz AG(梅赛德斯-奔驰集团);Technical University of Munich(慕尼黑技术大学);Purdue University(普渡大学);Space Robotics Research Group, SnT, University of Luxembourg(卢森堡大学空间机器人研究组);Torc Robotics(Torc机器人公司);Princeton University(普林斯顿大学)
Hanging Around: Cognitive Inspired Reasoning for Reactive Robotics
Applied Linguistics Department University of Bremen(应用语言学系 比勒feld大学);Digital Media Lab University of Bremen(数字媒体实验室 比勒feld大学);Department of Computer Science KU Leuven(计算机科学系 卢森堡大学)
When Planners Meet Reality: How Learned, Reactive Traffic Agents Shift nuPlan Benchmarks
Robert Bosch GmbH(罗伯特·博世有限公司);Institute for Neuro- and Bioinformatics, University of Lübeck(神经与生物医学研究所,吕贝克大学);Engineering Faculty, DHBW Stuttgart(工程学院,斯图加特DHBW);Department of Computer Science, University of Freiburg(计算机科学系,弗赖堡大学)
Federated Deep Learning Meets Autonomous Vehicle Perception: Design and Verification
Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));University of New South Wales(新南威尔士大学);Weizmann Institute of Science(魏茨曼科学研究所);Princeton University(普林斯顿大学);Southern University of Science and Technology(南方科技大学);Shenzhen Research Institute of Trustworthy Autonomous Systems(深圳市可信自主系统研究院);University of Macau(澳门大学)
Hybrid Task and Motion Planning with Reactive Collision Handling for Multi-Robot Disassembly of Complex Products: Application to EV Batteries
Extreme Robotics Laboratory, School of Metallurgy and Materials, University of Birmingham(极端机器人实验室,冶金与材料学院,伯明翰大学);Department of Applied Artificial Intelligence and Robotics, Aston University(应用人工智能与机器人学院,阿斯顿大学)
Event Camera Meets Mobile Embodied Perception: Abstraction, Algorithm, Acceleration, Application
Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);The University of Hong Kong(香港大学);Global Innovation Exchange, Tsinghua University(清华大学全球创新交换)
UAVs Meet Embodied Intelligence: Bridging Human Intents and Flying Dynamics Via Harnessing Physical-Digital AI Agents
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Beihang University(北京航空航天大学);Shanxi Datong University(山西大同大学);Johns Hopkins University(约翰斯·霍普金斯大学);University of Sanya(三亚学院);Wenzhou-Kean University(温州肯恩大学);Macau University of Science and Technology(澳门科技大学);KOKONI 3D, Moxin Technology(魔芯科技KOKONI 3D);University of Science and Technology of China(中国科学技术大学)
Omni-Perception: Omnidirectional Collision Avoidance for Legged Locomotion in Dynamic Environments
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Spatialtemporal AI(时空AI);The Hong Kong University of Science and Technology(香港科技大学);Department of Eletronic Engineering, Tsinghua University(清华大学电子工程系);Beijing Innovation Center of Humanoid Robotics Co., Ltd.(北京人形机器人创新中心有限公司)
Reflex: Visually Grounded Reactive Humanoid Control
University of Washington(华盛顿大学);Stanford University(斯坦福大学);University of Southern California(南加州大学);National University of Singapore(新加坡国立大学);University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校);Allen Institute for AI(艾伦人工智能研究所)
UAVs Meet LLMs: Overviews and Perspectives Toward Agentic Low-Altitude Mobility
The State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所多模态人工智能系统国家重点实验室);Macau University of Science and Technology(澳门科技大学);School of Automation, Beijing Institute of Technology(北京理工大学自动化学院);School of Software, Northwestern Polytechnical University(西北工业大学软件学院);College of Mechanical and Vehicle Engineering, Hunan University(湖南大学机械与运载工程学院);John von Neumann Faculty of Informatics, Obuda University(欧布达大学约翰·冯·诺依曼信息学院)