arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.07223cs.LGcs.RO
收藏

Domain Curiosity:学习领域自适应的有效数据汇集策略

Domain Curiosity: Learning Efficient Data Collection Strategies for Domain Adaptation

Aalto University(阿尔托大学)

Karol Arndt, Oliver Struckmeier, Ville Kyrki

摘要:

领域自适应是机器人学中的一个常见问题,其应用包括将策略从仿真转移到现实世界和终身学习。然而,执行这种适应需要在适应期间提供关于环境的信息数据。在本文中,我们提出了领域好奇心-一种训练探索性策略的方法,这些策略被显式优化以提供允许模型学习环境未知方面的数据。与大多数好奇心方法相比,我们的方法明确地奖励学习,这使得它对环境噪声具有鲁棒性,而不会牺牲其学习能力。我们评估所提出的方法,通过比较多少模型可以了解环境动态给定的数据收集的方法,相比标准的好奇和随机的政策。使用玩具环境,两个模拟机器人设置,并在现实世界的触觉探索任务的评估。结果表明,所提出的方法允许数据有效和准确的动态估计。

英文摘要:

Domain adaptation is a common problem in robotics, with applications such as transferring policies from simulation to real world and lifelong learning. Performing such adaptation, however, requires informative data about the environment to be available during the adaptation. In this paper, we present domain curiosity -- a method of training exploratory policies that are explicitly optimized to provide data that allows a model to learn about the unknown aspects of the environment. In contrast to most curiosity methods, our approach explicitly rewards learning, which makes it robust to environment noise without sacrificing its ability to learn. We evaluate the proposed method by comparing how much a model can learn about environment dynamics given data collected by the proposed approach, compared to standard curious and random policies. The evaluation is performed using a toy environment, two simulated robot setups, and on a real-world haptic exploration task. The results show that the proposed method allows data-efficient and accurate estimation of dynamics.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑