Recent work in sim2real has successfully enabled robots to act in physical environments by training in simulation with a diverse ''population'' of environments (i.e. domain randomization). In this work, we focus on enabling generalization in assistive tasks: tasks in which the robot is acting to assist a user (e.g. helping someone with motor impairments with bathing or with scratching an itch). Such tasks are particularly interesting relative to prior sim2real successes because the environment now contains a human who is also acting. This complicates the problem because the diversity of human users (instead of merely physical environment parameters) is more difficult to capture in a population, thus increasing the likelihood of encountering out-of-distribution (OOD) human policies at test time. We advocate that generalization to such OOD policies benefits from (1) learning a good latent representation for human policies that test-time humans can accurately be mapped to, and (2) making that representation adaptable with test-time interaction data, instead of relying on it to perfectly capture the space of human policies based on the simulated population only. We study how to best learn such a representation by evaluating on purposefully constructed OOD test policies. We find that sim2real methods that encode environment (or population) parameters and work well in tasks that robots do in isolation, do not work well in assistance. In assistance, it seems crucial to train the representation based on the history of interaction directly, because that is what the robot will have access to at test time. Further, training these representations to then predict human actions not only gives them better structure, but also enables them to be fine-tuned at test-time, when the robot observes the partner act. https://adaptive-caregiver.github.io.
Learning Multimodal AI Algorithms for Amplifying Limited User Input into High-dimensional Control Space
Department of Electrical, Computer, and Biomedical Engineering, University of Rhode Island(电气、计算机与生物医学工程系,罗德岛大学);Department of Electrical and Computer Engineering, Northeastern University(电气与计算机工程系,东北大学);Department of Neurology, Harvard Medical School(神经病学系,哈佛医学院)
Bandwidth Enables Generalization in Quantum Kernel Models
Flatiron Institute(熨斗研究所);University of Waterloo(滑铁卢大学);Harvard University(哈佛大学);Lawrence Berkeley National Laboratory(劳伦斯伯克利国家实验室);JPMorgan Chase(摩根大通)