通过“A Game Of Sorts”收集视觉基础对话
Collecting Visually-Grounded Dialogue with A Game Of Sorts
AI总结：
针对先前视觉基础对话研究对指代过程过度简化的问题，提出协作式图像排序游戏“A Game Of Sorts”，通过不受限制的对称对话收集涉及协作指代过程的讨论数据，并公开相关材料。
摘要：
关于（情境）对话中指代表达生成与基础化过程的一种理想化但简化的观点认为，说话者只需适当地指定其表达，以便听话者能成功识别目标指代物。然而，对话中的指代是一个协作过程，不能被恰当地描述为最小化指定的指代表达的交换。先前关于视觉基础对话的研究所做出的假设引发了担忧，这些假设揭示了对对话和指代过程的过度简化观点。我们通过引入协作式图像排序任务来解决这些问题，这是一个我们称之为“A Game Of Sorts”的基础化协议游戏。在我们的游戏中，给定某种排序标准，玩家需要通过基本上不受限制的、角色对称的对话，就如何对一组图像进行排序达成一致。通过强调这种混合主动交互中的论证，我们收集了涉及协作指代过程的讨论。我们描述了使用所提任务进行小规模数据收集实验的结果。所有讨论的材料，包括收集的数据、代码库和应用程序的容器化版本，都是公开可用的。
英文摘要：
An idealized, though simplistic, view of the referring expression production and grounding process in (situated) dialogue assumes that a speaker must merely appropriately specify their expression so that the target referent may be successfully identified by the addressee. However, referring in conversation is a collaborative process that cannot be aptly characterized as an exchange of minimally-specified referring expressions. Concerns have been raised regarding assumptions made by prior work on visually-grounded dialogue that reveal an oversimplified view of conversation and the referential process. We address these concerns by introducing a collaborative image ranking task, a grounded agreement game we call "A Game Of Sorts". In our game, players are tasked with reaching agreement on how to rank a set of images given some sorting criterion through a largely unrestricted, role-symmetric dialogue. By putting emphasis on the argumentation in this mixed-initiative interaction, we collect discussions that involve the collaborative referential process. We describe results of a small-scale data collection experiment with the proposed task. All discussed materials, which includes the collected data, the codebase, and a containerized version of the application, are publicly available.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
