Meta Arcade:一个可配置的元学习环境套件
Meta Arcade: A Configurable Environment Suite for Meta-Learning
摘要:
深度强化学习(DRL)的大多数方法都试图一次解决一个任务。因此,大多数现有的研究基准由具有共同界面但在感知特征、目标或奖励结构方面几乎没有重叠的单个游戏或游戏套件组成。为了促进对受过训练的代理之间的知识转移的研究(例如,通过多任务和元学习),需要更多的环境套件,这些环境套件提供具有足够共性的可配置任务以供集体研究。在本文中,我们提出了Meta Arcade,一个工具,可以轻松地定义和配置自定义的2D街机游戏,共享共同的视觉效果,状态空间,动作空间,游戏组件和评分机制。Meta Arcade与先前环境的不同之处在于,任务通用性和可配置性都被优先考虑:整个游戏集可以从通用元素构建,并且这些元素可以通过暴露的参数进行调整。我们包括一套24个预定义的游戏,共同说明了这个框架的可能性,并讨论了这些游戏可以配置为研究应用程序。我们提供了几个实验来说明如何使用Meta Arcade,包括预定义游戏的单任务基准测试,在设定的时间表上改变游戏参数的基于示例的方法,以及游戏之间的迁移学习的探索。
英文摘要:
Most approaches to deep reinforcement learning (DRL) attempt to solve a single task at a time. As a result, most existing research benchmarks consist of individual games or suites of games that have common interfaces but little overlap in their perceptual features, objectives, or reward structures. To facilitate research into knowledge transfer among trained agents (e.g. via multi-task and meta-learning), more environment suites that provide configurable tasks with enough commonality to be studied collectively are needed. In this paper we present Meta Arcade, a tool to easily define and configure custom 2D arcade games that share common visuals, state spaces, action spaces, game components, and scoring mechanisms. Meta Arcade differs from prior environments in that both task commonality and configurability are prioritized: entire sets of games can be constructed from common elements, and these elements are adjustable through exposed parameters. We include a suite of 24 predefined games that collectively illustrate the possibilities of this framework and discuss how these games can be configured for research applications. We provide several experiments that illustrate how Meta Arcade could be used, including single-task benchmarks of predefined games, sample curriculum-based approaches that change game parameters over a set schedule, and an exploration of transfer learning between games.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。