arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1903.06754cs.LGcs.CVstat.ML
收藏

Atari-HEAD:Atari人类眼动追踪和演示数据集

Atari-HEAD: Atari Human Eye-Tracking and Demonstration Dataset

University of Texas at Austin(得克萨斯大学奥斯汀分校);Carnegie Mellon University(卡内基梅隆大学)

Ruohan Zhang, Calen Walshe, Zhuode Liu, Lin Guan, Karl S. Muller, Jake A. Whritner, Luxin Zhang, Mary M. Hayhoe, Dana H. Ballard

摘要:

大规模公共数据集已被证明有利于现代人工智能多个领域的研究。对于需要人类数据的决策研究,高质量的数据集可以作为重要的基准,通过提供通用的可重复标准来促进新方法的开发。许多人类决策任务需要视觉注意力来获得高水平的性能。因此,测量眼球运动可以提供有关人类用于解决决策任务的策略的丰富信息来源。在这里,我们提供了一个大规模,高质量的人类动作数据集,同时记录了人类玩Atari视频游戏时的眼球运动。该数据集包含来自20款游戏的117小时游戏数据,其中包含800万个动作演示和3.28亿个凝视样本。我们介绍了一种新颖的游戏形式,其中人类以半帧逐帧的方式进行游戏。这导致接近最佳的游戏决策和游戏分数,与已知的人类记录相当或更好。我们通过两个简单的应用程序证明了数据集的有用性:预测人类的目光和模仿人类表现出的动作。数据的质量使这两项任务都取得了可喜的成果。此外,使用学习的人类凝视模型来通知模仿学习,导致游戏性能提高115%。我们将这些结果解释为强调将人类视觉注意力纳入决策模型的重要性,并展示了当前数据集对研究界的价值。我们希望这个数据集的规模和质量可以为视觉注意,模仿学习和强化学习领域的研究人员提供更多的机会。

英文摘要:

Large-scale public datasets have been shown to benefit research in multiple areas of modern artificial intelligence. For decision-making research that requires human data, high-quality datasets serve as important benchmarks to facilitate the development of new methods by providing a common reproducible standard. Many human decision-making tasks require visual attention to obtain high levels of performance. Therefore, measuring eye movements can provide a rich source of information about the strategies that humans use to solve decision-making tasks. Here, we provide a large-scale, high-quality dataset of human actions with simultaneously recorded eye movements while humans play Atari video games. The dataset consists of 117 hours of gameplay data from a diverse set of 20 games, with 8 million action demonstrations and 328 million gaze samples. We introduce a novel form of gameplay, in which the human plays in a semi-frame-by-frame manner. This leads to near-optimal game decisions and game scores that are comparable or better than known human records. We demonstrate the usefulness of the dataset through two simple applications: predicting human gaze and imitating human demonstrated actions. The quality of the data leads to promising results in both tasks. Moreover, using a learned human gaze model to inform imitation learning leads to an 115\% increase in game performance. We interpret these results as highlighting the importance of incorporating human visual attention in models of decision making and demonstrating the value of the current dataset to the research community. We hope that the scale and quality of this dataset can provide more opportunities to researchers in the areas of visual attention, imitation learning, and reinforcement learning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑