果冻豆世界:永不停止学习的试验台
Jelly Bean World: A Testbed for Never-Ending Learning
摘要:
机器学习近年来取得了越来越大的成功。然而,当前的机器学习系统是高度专业化的,针对特定问题或领域进行训练,并且通常在单个狭窄的数据集上进行训练。另一方面,人类的学习具有高度的普遍性和适应性。永无止境的学习是一种机器学习范式,旨在弥合这一差距,其目标是鼓励研究人员设计机器学习系统,这些系统可以学习在更复杂的环境中执行更广泛的相互关联的任务。到目前为止,还没有环境或测试平台来促进永无止境的学习系统的开发和评估。为此,我们提出了果冻豆世界测试平台。果冻豆世界允许在二维网格世界上进行实验,这些世界充满了物品,代理可以在其中导航。该测试平台提供了足够复杂的环境,并且更普遍的智能算法应该比当前最先进的强化学习方法表现得更好。它通过产生非静态环境和促进多任务,多代理,多模式和课程学习设置的实验。我们希望这个新的免费软件将促进新的研究和兴趣的开发和评估永无止境的学习系统,更广泛地说,一般的智能系统。
英文摘要:
Machine learning has shown growing success in recent years. However, current machine learning systems are highly specialized, trained for particular problems or domains, and typically on a single narrow dataset. Human learning, on the other hand, is highly general and adaptable. Never-ending learning is a machine learning paradigm that aims to bridge this gap, with the goal of encouraging researchers to design machine learning systems that can learn to perform a wider variety of inter-related tasks in more complex environments. To date, there is no environment or testbed to facilitate the development and evaluation of never-ending learning systems. To this end, we propose the Jelly Bean World testbed. The Jelly Bean World allows experimentation over two-dimensional grid worlds which are filled with items and in which agents can navigate. This testbed provides environments that are sufficiently complex and where more generally intelligent algorithms ought to perform better than current state-of-the-art reinforcement learning approaches. It does so by producing non-stationary environments and facilitating experimentation with multi-task, multi-agent, multi-modal, and curriculum learning settings. We hope that this new freely-available software will prompt new research and interest in the development and evaluation of never-ending learning systems and more broadly, general intelligence systems.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。