重温街机学习环境:一般代理的评估协议和开放问题
Revisiting the Arcade Learning Environment: Evaluation Protocols and Open Problems for General Agents
摘要:
Arcade Learning Environment(ALE)是一个评估平台,它提出了在数十个Atari 2600游戏中构建具有一般能力的人工智能智能体的挑战。它支持各种不同的问题设置,并且越来越受到科学界的关注,导致了一些备受瞩目的成功案例,例如广为宣传的Deep Q-Networks(DQN)。在这篇文章中,我们将全面了解研究社区如何使用ALE。我们展示了如何多样化的评估方法在ALE已成为随着时间的推移,并强调一些关键问题时,评估代理人在ALE。我们利用这一讨论来提出一些方法的最佳实践,并使用这些最佳实践提供新的基准测试结果。为了进一步在该领域的进展,我们引入了一个新版本的ALE,支持多种游戏模式,并提供了一种形式的随机性,我们称之为粘性行动。我们通过重新审视ALE引入时所带来的挑战,总结各种问题的最新技术水平,并突出仍然存在的问题来总结这一大局。
英文摘要:
The Arcade Learning Environment (ALE) is an evaluation platform that poses the challenge of building AI agents with general competency across dozens of Atari 2600 games. It supports a variety of different problem settings and it has been receiving increasing attention from the scientific community, leading to some high-profile success stories such as the much publicized Deep Q-Networks (DQN). In this article we take a big picture look at how the ALE is being used by the research community. We show how diverse the evaluation methodologies in the ALE have become with time, and highlight some key concerns when evaluating agents in the ALE. We use this discussion to present some methodological best practices and provide new benchmark results using these best practices. To further the progress in the field, we introduce a new version of the ALE that supports multiple game modes and provides a form of stochasticity we call sticky actions. We conclude this big picture look by revisiting challenges posed when the ALE was introduced, summarizing the state-of-the-art in various problems and highlighting problems that remain open.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。