This paper proposes a novel approach that enables a robot to learn an objective function incrementally from human directional corrections. Existing methods learn from human magnitude corrections; since a human needs to carefully choose the magnitude of each correction, those methods can easily lead to over-corrections and learning inefficiency. The proposed method only requires human directional corrections -- corrections that only indicate the direction of an input change without indicating its magnitude. We only assume that each correction, regardless of its magnitude, points in a direction that improves the robot's current motion relative to an unknown objective function. The allowable corrections satisfying this assumption account for half of the input space, as opposed to the magnitude corrections which have to lie in a shrinking level set. For each directional correction, the proposed method updates the estimate of the objective function based on a cutting plane method, which has a geometric interpretation. We have established theoretical results to show the convergence of the learning process. The proposed method has been tested in numerical examples, a user study on two human-robot games, and a real-world quadrotor experiment. The results confirm the convergence of the proposed method and further show that the method is significantly more effective (higher success rate), efficient/effortless (less human corrections needed), and potentially more accessible (fewer early wasted trials) than the state-of-the-art robot learning frameworks.
A3RNN: Bi-directional Fusion of Bottom-up and Top-down Process for Developmental Visual Attention in Robots
Department of Intermedia Art and Science, Waseda University(媒体艺术与科学系,早稻田大学);Research Development Group, Hitachi, Ltd.(日立株式会社研发发展组);National Institute of Advanced Industrial Science and Technology (AIST)(国家先进工业科学与技术研究院)
Safe MPC Alignment with Human Directional Feedback
Intelligent Robotics and Interactive Systems (IRIS) Lab in the School for Engineering of Matter, Transport and Energy(智能机器人与交互系统实验室(IRIS));Polytechnic School(理工学院);School for Engineering of Matter, Transport and Energy(工程物质、运输与能量学院);Departments of Industrial Engineering & Management Sciences(工业工程与管理科学系);Department of Electrical and Systems Engineering(电气与系统工程系)
TATIC: Task-Aware Temporal Learning for Human Intent Inference from Physical Corrections in Human-Robot Collaboration
Department of Mechanical Engineering, Texas A&M University(机械工程系,德克萨斯农工大学);Department of Civil and Environmental Engineering, Texas A&M University(土木与环境工程系,德克萨斯农工大学)
Gaze-supported Large Language Model Framework for Bi-directional Human-Robot Interaction
Technical University of Munich(慕尼黑技术大学);Robert Bosch GmbH, Corporate Research(博世集团,企业研究);Centre for Applied Autonomous Sensor Systems (AASS)(应用自主传感器系统中心(AASS))
VLA Model-Expert Collaboration for Bi-directional Manipulation Learning
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
Kairos: Grounded Forecasting of Presence and Directional Flow in 4D Scene Graphs
University of Turku(图尔库大学);Centre for Artificial Intelligence, Zürich University of Applied Sciences(苏黎世应用科学大学人工智能中心);Instituto Tecnológico de Aragón (ITA)(阿拉贡技术研究所);University of Zaragoza(萨拉戈萨大学)