Sufficiently perceiving the environment is a critical factor in robot motion generation. Although the introduction of deep visual processing models have contributed in extending this ability, existing methods lack in the ability to actively modify what to perceive; humans perform internally during visual cognitive processes. This paper addresses the issue by proposing a novel robot motion generation model, inspired by a human cognitive structure. The model incorporates a state-driven active top-down visual attention module, which acquires attentions that can actively change targets based on task states. We term such attentions as role-based attentions, since the acquired attention directed to targets that shared a coherent role throughout the motion. The model was trained on a robot tool-use task, in which the role-based attentions perceived the robot grippers and tool as identical end-effectors, during object picking and object dragging motions respectively. This is analogous to a biological phenomenon called tool-body assimilation, in which one regards a handled tool as an extension of one's body. The results suggested an improvement of flexibility in model's visual perception, which sustained stable attention and motion even if it was provided with untrained tools or exposed to experimenter's distractions.
Data-Driven Prediction of Dynamic Interactions Between Robot Appendage and Granular Material
The Institute for Data Intensive Engineering and Science(数据密集工程与科学研究所);Hopkins Extreme Materials Institute(霍普金斯极端材料研究所);Department of Mechanical Engineering(机械工程系);Johns Hopkins University(约翰霍普金斯大学);University of Maryland(马里兰大学)
Ritsumeikan University(立命馆大学);The University of Electro-Communications(电气通信大学);Okayama Prefectural University(冈山县立大学);Waseda University(早稻田大学);National Institute of Advanced Industrial Science and Technology(产业技术综合研究所)
Unveiling Complex Collective Behaviors from Simple Rewards
College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);WINDY Lab, School of Engineering, Westlake University(西湖大学工程学院风语实验室);Shanghai AI Laboratory(上海人工智能实验室);Max Planck Institute of Animal Behavior(马克斯·普朗克动物行为研究所);Department of Computer and Information Science, University of Konstanz(康斯坦茨大学计算机与信息科学系);Centre for the Advanced Study of Collective Behaviour, University of Konstanz(康斯坦茨大学集体行为高级研究中心);Department of Biology, University of Konstanz(康斯坦茨大学生物系)
Facilitating the Emergence of Assistive Robots to Support Frailty: Psychosocial and Environmental Realities
University of Nottingham, School of Computer Science, Nottingham, UK(诺丁汉大学计算机科学学院);University of Sheffield, Sheffield, UK(谢菲尔德大学);University of Hertfordshire, Hatfield, UK(赫特福德大学);Heriot-Watt University, Edinburgh, UK(赫罗特-瓦特大学);Sheffield Hallam University, Sheffield, UK(谢菲尔德哈姆大学)
On the Emergence of Whole-body Strategies from Humanoid Robot Push-recovery Learning
Istituto Italiano di Tecnologia(意大利理工学院);University of Manchester(曼彻斯特大学);Massachusetts Institute of Technology(麻省理工学院);Sapienza Università di Roma(罗马第一大学);Università degli Studi di Genova(热那亚大学)
Sensorimotor representation learning for an "active self" in robots: A model survey
University of Hamburg(汉堡大学);Humboldt-Universität zu Berlin(柏林洪堡大学);University of Potsdam(波茨坦大学);Max Planck Institute for Human Cognitive and Brain Sciences(马克斯·普朗克人类认知与脑科学研究所)
安全的人机交互要求机器人能够学习如何在\sout{humans' world} \rev{spaces populated by people}中适当地表现,从而应对动态和非结构化环境带来的挑战,而不是提供一套严格的操作规则。在人类中,这些能力被认为与我们在空间中感知我们身体的能力有关,在运动过程中感知我们四肢的位置,意识到其他物体和代理,并控制我们的身体部位与它们进行有意的互动。对于下一代具有生物启发能力的机器人,在本文中,我们首先回顾了这些能力的基本机制的发展过程:身体图式的感觉表征,近个人空间和人类的主动自我。其次,我们提供了一个调查这些感官表征和机器人模型的自我机器人模型,我们比较这些模型与人类的同行。最后,我们分析了这些机器人模型中缺少的东西,并提出了一个理论计算框架,其目的是通过自我探索开发感官表征,使人工代理中自我意识的出现。
The Emergence of Deep Reinforcement Learning for Path Planning
Faculty of Information Technology, Monash University(墨尔本大学信息科技学院);Swinburne University of Technology(斯威本技术大学);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);The University of Queensland(昆士兰大学);Sungkyunkwan University(成均馆大学);Griffith University(格里菲斯大学)
SoloParkour: Constrained Reinforcement Learning for Visual Locomotion from Privileged Experience
LAAS-CNRS(法国国家科学研究中心自动化与系统分析实验室);Université de Toulouse(图卢兹大学);CNRS(法国国家科学研究中心);New York University(纽约大学);Artificial and Natural Intelligence Toulouse Institute(图卢兹人工与自然智能研究所)
RL-GSBridge: 3D Gaussian Splatting Based Real2Sim2Real Method for Robotic Manipulation Learning
Shenzhen Research Institute of Shanghai Jiao Tong University(上海交通大学深圳研究院);Shanghai Jiao Tong University(上海交通大学);School of Information and Control Engineering, China University of Mining and Technology(中国矿业大学信息与控制工程学院);University of Cambridge(剑桥大学)
Deep Generative Models in Robotics: A Survey on Learning from Multimodal Demonstrations
German Research Center for AI(德国人工智能研究中心);Nvidia(英伟达);Massachusetts Institute of Technology(麻省理工学院);New York University(纽约大学);Carnegie Mellon University(卡内基梅隆大学);Technische Universität Darmstadt(达姆施塔特工业大学);Georgia Institute of Technology(佐治亚理工学院)