arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~

多方对话中与数字代理的语音同步

Speech Entrainment in Multi-Party Conversations with a Digital Agent

Nicholas Mehlman, Kaitlin Zareno, Kleanthis Avramidis, Anfeng Xu, Shrikanth Narayanan

arXiv 2607.22939首次发表:更新:

AI 中文总结

研究人类群体与数字代理多方互动中的语音同步效应,通过收集含成人及家庭会话的独特数据集,考虑多种同步特征,发现个体局部与人同步,全局及与代理的同步有限且依群体而异。

AI 中文摘要

人们广泛观察到,参与对话的个体倾向于调整其说话风格以更紧密地匹配其他对话者。然而,大多数先前的工作都集中在人类之间的二元互动上。本文中,我们在一个新环境中研究同步效应:人类群体与数字代理之间的多方互动。这种场景为非人类参与者的参与如何调节短期和时间分辨的对话动态提供了重要见解。为解决这些问题,我们收集并分析了一个独特的数据集,该数据集由成人和家庭(父母/孩子)会话组成,使我们能够研究同步在这些群体中的不同表现。我们考虑了一系列基于知识和模型的同步特征,发现虽然个体在局部与其他人同步,但全局同步以及与代理的同步仍然有限且依赖于群体。

英文摘要

It has been widely observed that individuals engaged in conversation tend to adapt their speaking style to more closely match the other interlocutors. However, most prior work has focused on dyadic interactions among humans. In this paper, we investigate entrainment effects in a novel setting: a multi-party interaction between groups of humans and a digital agent. This scenario offers important insights into how the participation of non-human actors modulates both short-time and temporally resolved conversational dynamics. To address these questions, we collect and analyze a unique dataset that consists of both adult and family (parent/children) sessions, enabling us to examine how entrainment manifests differently across these cohorts. We consider a range of knowledge-driven and model-based entrainment features and find that, while individuals locally entrain with other humans, global entrainment, and entrainment with the agent remains limited and cohort-dependent.

论文原文

arXiv 摘要页 · PDF 原文 · HTML 原文

↑