arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1809.03406cs.AI
收藏

结合想象力和推理学来学习概括的策略

Combining imagination and heuristics to learn strategies that generalize

Carnegie Mellon University(卡内基梅隆大学);Carnegie Mellon Neuroscience Institute(卡内基梅隆神经科学研究所)

Erik J Peterson, Necati Alp Müyesser, Timothy Verstynen, Kyle Dunovan

摘要:

深度强化学习可以在稳定的环境中匹配或超过人类的表现,但与人类不同,人工网络通常无法适应环境的微小变化。人类依赖于简化计算负荷和想象力的组合,将体验式学习扩展到新的和更具挑战性的环境。受人类前额叶网络分层组织理论的启发,我们开发了一个分层强化学习模型,该模型将思维和想象力结合到一个绊脚石-策略网络中。我们使用Wythoff的游戏,一个已知的最佳策略的gridworld环境,这个网络的性能进行测试。我们发现,将每个位置标记为热或冷,结合想象的游戏,既加速了学习,又促进了向新游戏的转移,同时也提高了模型的可解释性。

英文摘要:

Deep reinforcement learning can match or exceed human performance in stable contexts, but with minor changes to the environment artificial networks, unlike humans, often cannot adapt. Humans rely on a combination of heuristics to simplify computational load and imagination to extend experiential learning to new and more challenging environments. Motivated by theories of the hierarchical organization of the human prefrontal networks, we have developed a model of hierarchical reinforcement learning that combines both heuristics and imagination into a stumbler-strategist network. We test performance of this network using Wythoff's game, a gridworld environment with a known optimal strategy. We show that a heuristic labeling of each position as hot or cold, combined with imagined play, both accelerates learning and promotes transfer to novel games, while also improving model interpretability.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑