Preference-based reinforcement learning (PbRL) has shown significant promise for personalization in human-robot interaction (HRI) by explicitly integrating human preferences into the robot learning process. However, existing practices often require training a personalized robot policy from scratch, resulting in inefficient use of human feedback. In this paper, we propose preference-based action representation learning (PbARL), an efficient fine-tuning method that decouples common task structure from preference by leveraging pre-trained robot policies. Instead of directly fine-tuning the pre-trained policy with human preference, PbARL uses it as a reference for an action representation learning task that maximizes the mutual information between the pre-trained source domain and the target user preference-aligned domain. This approach allows the robot to personalize its behaviors while preserving original task performance and eliminates the need for extensive prior information from the source domain, thereby enhancing efficiency and practicality in real-world HRI scenarios. Empirical results on the Assistive Gym benchmark and a real-world user study (N=8) demonstrate the benefits of our method compared to state-of-the-art approaches.
HARMONI: Multimodal Personalization of Multi-User Human-Robot Interactions with LLMs
Institut Curie, Université Paris-Saclay(巴黎-萨克勒大学Curie研究所);Institute of Intelligent Systems and Robotics (ISIR), Sorbonne University(索邦大学智能系统与机器人研究所);Assistance Publique – Hôpitaux de Paris (AP-HP), Université Paris Cité(巴黎公共医院(AP-HP)与巴黎城市大学)
PERCY: Personal Emotional Robotic Conversational System
University of New South Wales(新南威尔士大学);University of Technology Sydney(悉尼科技大学);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);Universidad Central de Chile(智利中央大学)
The Impact of VR and 2D Interfaces on Human Feedback in Preference-Based Robot Learning
Humanoid Robots Lab, University of Bonn, Germany(波恩大学人形机器人实验室);Division of Robotics, Perception and Learning, KTH Royal Institute of Technology, Sweden(皇家理工学院机器人、感知与学习部门);Robotics Institute Germany(德国机器人研究所);The Lamarr Institute, Bonn, Germany(德国波恩拉玛尔研究所);Center for Robotics, University of Bonn, Germany(德国波恩机器人中心)
A Data-Driven Reinforcement Learning Solution Framework for Optimal and Adaptive Personalization of a Hip Exoskeleton
NC State University(北卡罗来纳州立大学);University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校);Arizona State University(亚利桑那州立大学);Hubei University of Technology(湖北工业大学)
University of California, Riverside(加州大学河滨分校);Yale University(耶鲁大学);Georgia Institute of Technology(佐治亚理工学院);University of Michigan, Ann Arbor(密歇根大学安娜堡分校);University of Toronto(多伦多大学)