在丰富的3D块世界中学习可解释的空间操作
Learning Interpretable Spatial Operations in a Rich 3D Blocks World
摘要:
在本文中,我们研究的问题映射自然语言指令到复杂的空间动作在一个三维块世界。我们首先介绍了一个新的数据集,对复杂的三维空间操作丰富的自然语言的描述,需要复杂的空间和务实的解释,如“镜像”,“扭曲”,“平衡”。这个数据集建立在Bisk,Yuret和Marcu(2016)的模拟环境上,获得了更丰富和更复杂的语言,同时也使2D环境中的原始数据集的大小增加了一倍,具有100个新的世界配置和250,000个令牌。此外,我们提出了一种新的神经架构,它可以在自动发现可解释的空间操作库存的同时实现竞争性结果(图5)。
英文摘要:
In this paper, we study the problem of mapping natural language instructions to complex spatial actions in a 3D blocks world. We first introduce a new dataset that pairs complex 3D spatial operations to rich natural language descriptions that require complex spatial and pragmatic interpretations such as "mirroring", "twisting", and "balancing". This dataset, built on the simulation environment of Bisk, Yuret, and Marcu (2016), attains language that is significantly richer and more complex, while also doubling the size of the original dataset in the 2D environment with 100 new world configurations and 250,000 tokens. In addition, we propose a new neural architecture that achieves competitive results while automatically discovering an inventory of interpretable spatial operations (Figure 5)
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。