基于互动的学习
Interaction-Grounded Learning
摘要:
考虑假肢,学习适应用户的控制信号。我们提出了互动接地学习这种新的设置,其中学习者的目标是与环境互动,没有接地或明确的奖励,以优化其政策。这样的问题回避了需要显式奖励的常见RL解决方案。学习代理观察多维上下文向量,采取行动,然后观察多维反馈向量。这个多维反馈向量没有明确的奖励信息。为了成功,算法必须学习如何评估反馈向量以发现潜在的奖励信号,从而可以在没有监督的情况下确定其策略。我们表明,在一个互动接地学习设置,与某些自然的假设,学习者可以发现潜在的奖励和地面成功的互动政策。我们提供了理论保证和概念验证的实证评估,以证明我们所提出的方法的有效性。
英文摘要:
Consider a prosthetic arm, learning to adapt to its user's control signals. We propose Interaction-Grounded Learning for this novel setting, in which a learner's goal is to interact with the environment with no grounding or explicit reward to optimize its policies. Such a problem evades common RL solutions which require an explicit reward. The learning agent observes a multidimensional context vector, takes an action, and then observes a multidimensional feedback vector. This multidimensional feedback vector has no explicit reward information. In order to succeed, the algorithm must learn how to evaluate the feedback vector to discover a latent reward signal, with which it can ground its policies without supervision. We show that in an Interaction-Grounded Learning setting, with certain natural assumptions, a learner can discover the latent reward and ground its policy for successful interaction. We provide theoretical guarantees and a proof-of-concept empirical evaluation to demonstrate the effectiveness of our proposed approach.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。