arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2109.01768cs.LGcs.AI
收藏

Eden:一个支持强化学习算法的统一环境框架

Eden: A Unified Environment Framework for Booming Reinforcement Learning Algorithms

Institute of Software Chinese Academy of Sciences(中国科学院软件研究所);University of Science and Technology of China(中国科学技术大学)

Ruizhi Chen, Xiaoyu Wu, Yansong Pan, Kaizhao Yuan, Ling Li, TianYun Ma, JiYuan Liang, Rui Zhang, Kai Wang, Chen Zhang, Shaohui Peng, Xishan Zhang, Zidong Du, Qi Guo, Yunji Chen

摘要:

随着AlphaGo击败顶级人类选手,强化学习(RL)算法逐渐成为构建更强大人工智能(AI)的代码基础。强化学习算法设计首先需要适应特定的环境,因此所设计的环境引导着强化学习算法的快速而深入的发展。然而,现有的环境,其中可分为现实世界的游戏和定制的玩具环境,有明显的缺点。对于现实世界的游戏,它是为人类娱乐而设计的,对于大多数RL研究人员来说太困难了。对于定制的玩具环境,所有RL算法都没有被广泛接受的统一评估标准。因此,我们介绍了第一个虚拟用户友好的环境框架RL。在该框架中,可以方便地配置环境,以实现主流研究中的各种强化学习任务。然后可以方便地评估和比较所有主流的最先进的(SOTA)RL算法。因此,我们的贡献主要包括以下几个方面:1.所有SOTA RL算法的单一配置环境; 2.多种RL算法的组合环境; 3.各种RL算法的评价标准。通过这些努力,为培育具有多种任务通用能力的人工智能提供了可能性,也许它将为人工智能开辟新的篇章。

英文摘要:

With AlphaGo defeats top human players, reinforcement learning(RL) algorithms have gradually become the code-base of building stronger artificial intelligence(AI). The RL algorithm design firstly needs to adapt to the specific environment, so the designed environment guides the rapid and profound development of RL algorithms. However, the existing environments, which can be divided into real world games and customized toy environments, have obvious shortcomings. For real world games, it is designed for human entertainment, and too much difficult for most of RL researchers. For customized toy environments, there is no widely accepted unified evaluation standard for all RL algorithms. Therefore, we introduce the first virtual user-friendly environment framework for RL. In this framework, the environment can be easily configured to realize all kinds of RL tasks in the mainstream research. Then all the mainstream state-of-the-art(SOTA) RL algorithms can be conveniently evaluated and compared. Therefore, our contributions mainly includes the following aspects: 1.single configured environment for all classification of SOTA RL algorithms; 2.combined environment of more than one classification RL algorithms; 3.the evaluation standard for all kinds of RL algorithms. With all these efforts, a possibility for breeding an AI with capability of general competency in a variety of tasks is provided, and maybe it will open up a new chapter for AI.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑