arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2212.03175cs.LGcs.AIcs.RO
收藏

在辅助任务中实现概括的学习表征

Learning Representations that Enable Generalization in Assistive Tasks

University of California Berkeley(加州大学伯克利分校);Carnegie Mellon University(卡内基梅隆大学);University of Utah(犹他大学)

Jerry Zhi-Yang He, Aditi Raghunathan, Daniel S. Brown, Zackory Erickson, Anca D. Dragan

摘要:

最近在sim2real中的工作已经成功地使机器人能够在物理环境中通过模拟不同的“群体”环境(即域随机化)进行训练。在这项工作中,我们专注于在辅助任务中实现泛化:机器人帮助用户的任务(例如,帮助有运动障碍的人洗澡或抓痒)。相对于之前的sim2real成功,这些任务特别有趣,因为环境现在包含一个也在行动的人。这使问题复杂化,因为人类用户的多样性(而不仅仅是物理环境参数)更难以在群体中捕获,从而增加了在测试时遇到分发外(OOD)人类策略的可能性。我们主张推广到这样的OOD策略受益于(1)学习测试时人类可以准确映射到的人类策略的良好潜在表示,以及(2)使该表示适应测试时的交互数据,而不是依赖于它来完美地捕获基于模拟人口的人类策略的空间。我们研究如何最好地学习这样一个代表性的评价有目的地构建面向对象的测试政策。我们发现,sim2real方法,编码环境(或人口)参数,并在机器人孤立的任务中工作得很好,在援助中工作得不好。在辅助方面,直接基于交互历史训练表示似乎至关重要,因为这是机器人在测试时将访问的内容。此外,训练这些表示来预测人类的行为不仅可以使它们具有更好的结构,而且还可以在机器人观察合作伙伴行为时在测试时对其进行微调。https://adaptive-caregiver.github.io.

英文摘要:

Recent work in sim2real has successfully enabled robots to act in physical environments by training in simulation with a diverse ''population'' of environments (i.e. domain randomization). In this work, we focus on enabling generalization in assistive tasks: tasks in which the robot is acting to assist a user (e.g. helping someone with motor impairments with bathing or with scratching an itch). Such tasks are particularly interesting relative to prior sim2real successes because the environment now contains a human who is also acting. This complicates the problem because the diversity of human users (instead of merely physical environment parameters) is more difficult to capture in a population, thus increasing the likelihood of encountering out-of-distribution (OOD) human policies at test time. We advocate that generalization to such OOD policies benefits from (1) learning a good latent representation for human policies that test-time humans can accurately be mapped to, and (2) making that representation adaptable with test-time interaction data, instead of relying on it to perfectly capture the space of human policies based on the simulated population only. We study how to best learn such a representation by evaluating on purposefully constructed OOD test policies. We find that sim2real methods that encode environment (or population) parameters and work well in tasks that robots do in isolation, do not work well in assistance. In assistance, it seems crucial to train the representation based on the history of interaction directly, because that is what the robot will have access to at test time. Further, training these representations to then predict human actions not only gives them better structure, but also enables them to be fine-tuned at test-time, when the robot observes the partner act. https://adaptive-caregiver.github.io.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑