Humans are highly skilled in communicating their intent for when and where a handover would occur. However, even the state-of-the-art robotic implementations for handovers typically lack of such communication skills. This study investigates visualization of the robot's internal state and intent for Human-to-Robot Handovers using Augmented Reality. Specifically, we explore the use of visualized 3D models of the object and the robotic gripper to communicate the robot's estimation of where the object is and the pose in which the robot intends to grasp the object. We tested this design via a user study with 16 participants, in which each participant handed over a cube-shaped object to the robot 12 times. Results show communicating robot intent via augmented reality substantially improves the perceived experience of the users for handovers. Results also indicate that the effectiveness of augmented reality is even more pronounced for the perceived safety and fluency of the interaction when the robot makes errors in localizing the object.
Intent-Handover: Grounding Language in Human-Usage Regions for Trustworthy Robot-to-Human Handovers
DANiLab, University of Leicester（莱斯特大学DANiLab）；University of Leicester（莱斯特大学）；School of Computing and Mathematical Sciences, University of Leicester（莱斯特大学计算与数学科学学院）；School of Metallurgy and Materials, University of Birmingham（伯明翰大学冶金与材料学院）
A robotic system which approximates the user intention and appropriate complimentary motion is critical for successful human-robot interaction. %While the existing wearable sensors can monitor human movements in real-time, prediction of human movement is a significant challenge due to its highly non-linear motions optimised through the redundancy in the degrees of freedom. Here, we demonstrate robustness of the Gaussian Process (GP) clustered with a stochastic classification technique for trajectory prediction using an object handover scenario. By parametrising real 6D hand movements during hu…
RGB-D Video Generation for Improving Human-to-Robot Object Handover Prediction
Nanyang Technological University（南洋理工大学）；College of Computing and Data Science（计算与数据科学学院）；Zhejiang University（浙江大学）；College of Computer Science and Technology（计算机科学与技术学院）；Alibaba Group（阿里巴巴集团）
NVIDIA, USA（NVIDIA（美国））；University of Washington, USA（华盛顿大学（美国））
Transfer of objects between humans and robots is a critical capability for collaborative robots. Although there has been a recent surge of interest in human-robot handovers, most prior research focus on robot-to-human handovers. Further, work on the equally critical human-to-robot handovers often assumes humans can place the object in the robot's gripper. In this paper, we propose an approach for human-to-robot handovers in which the robot meets the human halfway, by classifying the human's grasp of the object and quickly planning a trajectory accordingly to take the object from the human's ha…
Simon Fraser University（西蒙弗雷泽大学）；University of Regina（里贾纳大学）
We present a robot-to-human object handover algorithm and implement it on a 7-DOF arm equipped with a 3-finger mechanical hand. The system performs a fully autonomous and robust object handover to a human receiver in real-time. Our algorithm relies on two complementary sensor modalities: joint torque sensors on the arm and an eye-in-hand RGB-D camera for sensor feedback. Our approach is entirely implicit, i.e., there is no explicit communication between the robot and the human receiver. Information obtained via the aforementioned sensor modalities is used as inputs to their related deep neural…
We present an approach for visualizing mobile robots through an Augmented Reality headset when there is no line-of-sight visibility between the robot and the human. Three elements are visualized in Augmented Reality: 1) Robot's 3D model to indicate its position, 2) An arrow emanating from the robot to indicate its planned movement direction, and 3) A 2D grid to represent the ground plane. We conduct a user study with 18 participants, in which each participant are asked to retrieve objects, one at a time, from stations at the two sides of a T-junction at the end of a hallway where a mobile robo…
University of Massachusetts Lowell（马萨诸塞大学洛厄尔分校）；Colorado School of Mines（科罗拉多矿业大学）
For mobile robots, mobile manipulators, and autonomous vehicles to safely navigate around populous places such as streets and warehouses, human observers must be able to understand their navigation intent. One way to enable such understanding is by visualizing this intent through projections onto the surrounding environment. But despite the demonstrated effectiveness of such projections, no open codebase with an integrated hardware setup exists. In this work, we detail the empirical evidence for the effectiveness of such directional projections, and share a robot-agnostic implementation of suc…
