arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2106.04887cs.LGcs.AIstat.ML
收藏

基于互动的学习

Interaction-Grounded Learning

University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Microsoft Research(微软研究院)

Tengyang Xie, John Langford, Paul Mineiro, Ida Momennejad

摘要:

考虑假肢,学习适应用户的控制信号。我们提出了互动接地学习这种新的设置,其中学习者的目标是与环境互动,没有接地或明确的奖励,以优化其政策。这样的问题回避了需要显式奖励的常见RL解决方案。学习代理观察多维上下文向量,采取行动,然后观察多维反馈向量。这个多维反馈向量没有明确的奖励信息。为了成功,算法必须学习如何评估反馈向量以发现潜在的奖励信号,从而可以在没有监督的情况下确定其策略。我们表明,在一个互动接地学习设置,与某些自然的假设,学习者可以发现潜在的奖励和地面成功的互动政策。我们提供了理论保证和概念验证的实证评估,以证明我们所提出的方法的有效性。

英文摘要:

Consider a prosthetic arm, learning to adapt to its user's control signals. We propose Interaction-Grounded Learning for this novel setting, in which a learner's goal is to interact with the environment with no grounding or explicit reward to optimize its policies. Such a problem evades common RL solutions which require an explicit reward. The learning agent observes a multidimensional context vector, takes an action, and then observes a multidimensional feedback vector. This multidimensional feedback vector has no explicit reward information. In order to succeed, the algorithm must learn how to evaluate the feedback vector to discover a latent reward signal, with which it can ground its policies without supervision. We show that in an Interaction-Grounded Learning setting, with certain natural assumptions, a learner can discover the latent reward and ground its policy for successful interaction. We provide theoretical guarantees and a proof-of-concept empirical evaluation to demonstrate the effectiveness of our proposed approach.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑