Open-World Object Motion Anticipation via Meta-Learned Semantic Adaptation
Amazon Fulfillment Technologies & Robotics(亚马逊履约技术与机器人部门);Massachusetts Institute of Technology(麻省理工学院);University of Iowa(爱荷华大学);Northeastern University(东北大学)
Mason Peterson, Gage MacLin, Camilla Tabasso, Jonathan P. How, Joshua Migdal, Tye Brady, Taskin Padir
Anticipating the motion of nearby objects is critical for safe and efficient robot navigation. Without a proper understanding of what may move, a robot may plan overly conservative, inefficient trajectories to guarantee safety, or it may be overly risky, resulting in unacceptable collisions. While tracking and predicting the motion of known objects has seen significant progress, little research addresses how a robot should adapt online to novel objects, including anticipating how one object may move another (e.g., a person operating a forklift to move a pallet). To enable this capability, we propose a meta-learned graph neural network that leverages a semantic, geometric, and relational history of objects to accurately predict, from a few online observations, when objects will begin to move in new environments. We demonstrate that our method, which is trained only in simulation, accurately anticipates the motion of objects unseen at training time, transfers to hardware without any fine-tuning, and outperforms a vision-language model and a class-frequency baseline in both simulation and hardware experiments. Our method's accurate prediction enables collision-free traversals in a closed-loop navigation simulation, while remaining within four seconds of the fastest, collision-prone planner.
Delft University of Technology(代尔夫特理工大学);University Libre du Bruxelles(布鲁塞尔自由大学);Fraunhofer Institute for Manufacturing Engineering and Automation IPA(弗劳恩霍夫制造工程与自动化研究所IPA)
自适应可以用于机器人技术,以提高系统的鲁棒性和可靠性。这项工作描述了机器人自适应的元控制方法。特别是,它详细介绍了MROS(Metacontrol for ROS Systems)框架如何实现和封装Metacontrol,并演示了MROS如何应用于移动机器人在工厂车间导航的导航场景。视频:https://www.youtube.com/watch? v=ISe9aMskJuE
Meta-Learning for Fast Adaptation in Intent Inferral on a Robotic Hand Orthosis for Stroke
Department of Mechanical Engineering, Columbia University in the City of New York(机械工程系,哥伦比亚大学(纽约市));Department of Computer Science, Columbia University in the City of New York(计算机科学系,哥伦比亚大学(纽约市));Department of Rehabilitation and Regenerative Medicine, Columbia University Irving Medical Center(康复与再生医学系,哥伦比亚大学伊万斯医学中心)
Meta-Learning Online Dynamics Model Adaptation in Off-Road Autonomous Driving
Jet Propulsion Laboratory, California Institute of Technology(喷气推进实验室、加州理工学院);University of Texas at Austin(德克萨斯大学奥斯汀分校);Georgia Institute of Technology(佐治亚理工学院)