An Epistemic Human-Aware Task Planner which Anticipates Human Beliefs and Decisions
LAAS-CNRS(法国国家科学研究中心自动化与系统分析实验室);Université de Toulouse(图卢兹大学);CNRS(法国国家科学研究中心);INSA(国立应用科学学院);UPS(图卢兹第三大学);Artificial and Natural Intelligence Toulouse Institute (ANITI)(图卢兹人工与自然智能研究所)
We present a substantial extension of our Human-Aware Task Planning framework, tailored for scenarios with intermittent shared execution experiences and significant belief divergence between humans and robots, particularly due to the uncontrollable nature of humans. Our objective is to build a robot policy that accounts for uncontrollable human behaviors, thus enabling the anticipation of possible advancements achieved by the robot when the execution is not shared, e.g. when humans are briefly absent from the shared environment to complete a subtask. But, this anticipation is considered from the perspective of humans who have access to an estimated model for the robot. To this end, we propose a novel planning framework and build a solver based on AND-OR search, which integrates knowledge reasoning, including situation assessment by perspective taking. Our approach dynamically models and manages the expansion and contraction of potential advances while precisely keeping track of when (and when not) agents share the task execution experience. The planner systematically assesses the situation and ignores worlds that it has reason to think are impossible for humans. Overall, our new solver can estimate the distinct beliefs of the human and the robot along potential courses of action, enabling the synthesis of plans where the robot selects the right moment for communication, i.e. informing, or replying to an inquiry, or defers ontic actions until the execution experiences can be shared. Preliminary experiments in two domains, one novel and one adapted, demonstrate the effectiveness of the framework.
Anticipate & Collab: Data-driven Task Anticipation and Knowledge-driven Planning for Human-robot Collaboration
Robotics Research Center, IIIT Hyderabad(IIIT海得拉巴机器人研究中心);TCS Research, Tata Consultancy Services(塔塔咨询服务公司TCS研究院);School of Informatics, University of Edinburgh(爱丁堡大学信息学院)
HOPE: A Reinforcement Learning-based Hybrid Policy Path Planner for Diverse Parking Scenarios
Department of Automation, Shanghai Jiao Tong University(自动化系,上海交通大学);Global Institute of Future Technology, Shanghai Jiao Tong University(未来技术全球研究院,上海交通大学)
Explainable deep learning improves human mental models of self-driving cars
Computer Science & Artificial Intelligence Laboratory (CSAIL), Massachusetts Institute of Technology(计算机科学与人工智能实验室(CSAIL),麻省理工学院);Motional AD Inc.(Motional AD公司);Department of Psychology and Center for Brain Science, Harvard University(心理学系和大脑科学中心,哈佛大学);Department of Aeronautics and Astronautics, Massachusetts Institute of Technology(航空与宇航系,麻省理工学院)
Trust-Aware Sequential Decision Making and Rollout Planning for Resilient Multi-Robot Systems
School of Engineering and Applied Sciences, Harvard University(哈佛大学工程与应用科学学院);Whiting School of Engineering at the Johns Hopkins University(约翰斯·霍普金斯大学惠廷工程学院)
University of Bonn(波恩大学);Autonomous Intelligent Systems (AIS) Group, Computer Science Institute VI(自主智能系统(AIS)组,计算机科学研究所VI)
In this paper, we propose a novel Deep Reinforcement Learning approach to address the mapless navigation problem, in which the locomotion actions of a humanoid robot are taken online based on the knowledge encoded in learned models. Planning happens by generating open-loop trajectories in a learned latent space that captures the dynamics of the environment. Our planner considers visual (RGB images) and non-visual observations (e.g., attitude estimations). This confers the agent upon awareness not only of the scenario, but also of its own state. In addition, we incorporate a termination likelih…
When learning to act in a stochastic, partially observable environment, an intelligent agent should be prepared to anticipate a change in its belief of the environment state, and be capable of adapting its actions on-the-fly to changing conditions. As humans, we are able to form contingency plans when learning a task with the explicit aim of being able to correct errors in the initial control, and hence prove useful if ever there is a sudden change in our perception of the environment which requires immediate corrective action. This is especially the case for autonomous vehicles (AVs) navigati…
Collaboration requires coordination, and we coordinate by anticipating our teammates' future actions and adapting to their plan. In some cases, our teammates' actions early on can give us a clear idea of what the remainder of their plan is, i.e. what action sequence we should expect. In others, they might leave us less confident, or even lead us to the wrong conclusion. Our goal is for robot actions to fall in the first category: we want to enable robots to select their actions in such a way that human collaborators can easily use them to correctly anticipate what will follow. While previous w…