Robots learn as they interact with humans. Consider a human teleoperating an assistive robot arm: as the human guides and corrects the arm's motion, the robot gathers information about the human's desired task. But how does the human know what their robot has inferred? Today's approaches often focus on conveying intent: for instance, upon legible motions or gestures to indicate what the robot is planning. However, closing the loop on robot inference requires more than just revealing the robot's current policy: the robot should also display the alternatives it thinks are likely, and prompt the human teacher when additional guidance is necessary. In this paper we propose a multimodal approach for communicating robot inference that combines both passive and active feedback. Specifically, we leverage information-rich augmented reality to passively visualize what the robot has inferred, and attention-grabbing haptic wristbands to actively prompt and direct the human's teaching. We apply our system to shared autonomy tasks where the robot must infer the human's goal in real-time. Within this context, we integrate passive and active modalities into a single algorithmic framework that determines when and which type of feedback to provide. Combining both passive and active feedback experimentally outperforms single modality baselines; during an in-person user study, we demonstrate that our integrated approach increases how efficiently humans teach the robot while simultaneously decreasing the amount of time humans spend interacting with the robot. Videos here: https://youtu.be/swq_u4iIP-g
Passive Realizations of Series Elastic Actuation: Effects of Plant and Controller Dynamics on Haptic Rendering Performance
Munich Institute of Robotics and Machine Intelligence at Technical University of Munich(慕尼黑工业大学慕尼黑机器人与机器智能学院);Faculty of Engineering and Natural Sciences at Sabanci University(萨班哲大学工程与自然科学学院);Sabancı University(萨班哲大学)
Encoding Biomechanical Energy Margin into Passivity-based Synchronization for Networked Telerobotic Systems
Department of Electrical and Computer Engineering, New York University(纽约大学电气与计算机工程系);New York University(纽约大学);NYUAD Center for Artificial Intelligence and Robotics(纽约大学人工智能与机器人中心);MathWorks
A Review of Surface Haptics:Enabling Tactile Effects on Touch Surfaces
Koc University(科奇大学);University of Lille(里尔大学);École de Technologie Supérieure(高等技术学院);Pohang University of Science and Technology (POSTECH)(浦项科技大学(POSTECH))
Passivity-based control for haptic teleoperation of a legged manipulator in presence of time-delays
Robotics System Lab (RSL), ETH Zurich(苏黎世联邦理工学院机器人系统实验室);Dynamic Legged Systems Lab, Istituto Italiano di Tecnologia (IIT)(意大利理工学院动态腿足系统实验室);Faculty of Electrical Engineering, Mathematics and Computer Science, University of Twente(特文特大学电气工程、数学与计算机科学学院)