arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2109.08994cs.CL
收藏

ReaSCAN:语言Grounding中的组合推理

ReaSCAN: Compositional Reasoning in Language Grounding

Stanford University(斯坦福大学);National University of Singapore(新加坡国立大学);IHPC, A*STAR(新加坡科技研究局信息与通信研究所)

Zhengxuan Wu, Elisa Kreiss, Desmond C. Ong, Christopher Potts

摘要:

将语言组合映射到指称、关系和动作的能力是语言理解的重要组成部分。最近的gSCAN数据集(Ruis et al. 2020,NeurIPS)是一个鼓舞人心的尝试,旨在评估模型在涉及导航指令的场景中学习这种基础的能力。然而,我们表明,gSCAN的高度约束的设计意味着,它不需要组合的解释,它的指令和场景的许多细节是不需要任务的成功。为了解决这些局限性,我们提出了ReaSCAN,这是一个基准数据集,它建立在gSCAN基础上,但需要对实体和关系进行组合语言解释和推理。我们在ReaSCAN上评估了两个模型:多模态基线和最先进的图卷积神经模型。这些实验表明,ReaSCAN对于两种神经架构都比gSCAN要难得多。这表明ReaSCAN可以作为一个有价值的基准,以促进我们对模型的组合泛化和推理能力的理解。

英文摘要:

The ability to compositionally map language to referents, relations, and actions is an essential component of language understanding. The recent gSCAN dataset (Ruis et al. 2020, NeurIPS) is an inspiring attempt to assess the capacity of models to learn this kind of grounding in scenarios involving navigational instructions. However, we show that gSCAN's highly constrained design means that it does not require compositional interpretation and that many details of its instructions and scenarios are not required for task success. To address these limitations, we propose ReaSCAN, a benchmark dataset that builds off gSCAN but requires compositional language interpretation and reasoning about entities and relations. We assess two models on ReaSCAN: a multi-modal baseline and a state-of-the-art graph convolutional neural model. These experiments show that ReaSCAN is substantially harder than gSCAN for both neural architectures. This suggests that ReaSCAN can serve as a valuable benchmark for advancing our understanding of models' compositional generalization and reasoning capabilities.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑