arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2305.19933cs.CLcs.AIcs.CV

说听众的语言:通过即插即用的心智理论实现受众感知的适应

Speaking the Language of Your Listener: Audience-Aware Adaptation via Plug-and-Play Theory of Mind

University of Amsterdam(阿姆斯特丹大学);Sapienza University of Rome(罗马第一大学)

Ece Takmaz, Nicolo' Brandizzi, Mario Giulianelli, Sandro Pezzelle, Raquel Fernández

AI总结:

本文提出一种即插即用的模拟模块,使说话者能从听者视角实时调整指称表达,无需微调语言模型即可提升交际成功率。

摘要:

对话参与者对所讨论话题的知识水平可能各不相同。在这种情况下,说话者必须考虑受众来调整自己的话语。然而,如何在计算智能体中建模这种适应仍然是一个悬而未决的问题。在本文中,我们建模了一个视觉 grounding 的指称游戏,其中一位知识丰富的说话者与一位视觉和语言经验更有限的听者进行互动。受心理语言学理论的启发,我们赋予说话者通过一个模拟模块来调整其指称表达的能力,该模块从听者的视角监测计划话语的有效性。我们提出了一种建立在即插即用可控语言生成方法之上的适应机制,其中话语生成由模拟器实时引导,而无需微调说话者的底层语言模型。我们的结果和分析表明,我们的方法是有效的:说话者的话语变得更接近听者的专业领域,从而带来更高的交际成功率。

英文摘要:

Dialogue participants may have varying levels of knowledge about the topic under discussion. In such cases, it is essential for speakers to adapt their utterances by taking their audience into account. Yet, it is an open question how such adaptation can be modelled in computational agents. In this paper, we model a visually grounded referential game between a knowledgeable speaker and a listener with more limited visual and linguistic experience. Inspired by psycholinguistic theories, we endow our speaker with the ability to adapt its referring expressions via a simulation module that monitors the effectiveness of planned utterances from the listener's perspective. We propose an adaptation mechanism building on plug-and-play approaches to controlled language generation, where utterance generation is steered on the fly by the simulator without finetuning the speaker's underlying language model. Our results and analyses show that our approach is effective: the speaker's utterances become closer to the listener's domain of expertise, which leads to higher communicative success.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑