arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2501.08946cs.CLcs.RO
收藏

将通用话轮转换模型应用于对话式人机交互

Applying General Turn-taking Models to Conversational Human-Robot Interaction

KTH Royal Institute of Technology(瑞典皇家理工学院)

Gabriel Skantze, Bahar Irfan

AI总结:

针对人机交互系统话轮转换不自然的问题,首次将TurnGPT和VAP两种通用话轮模型结合使用,无需领域微调,经39人参与的实验验证,该系统更受偏好且能减少响应延迟与打断。

摘要:

话轮转换是对话的基本要素,但当前的人机交互(HRI)系统通常依赖基于静默的简单模型,导致出现不自然的停顿和打断。本文首次探究了通用话轮转换模型——具体为TurnGPT和语音活动投影(VAP)——在改善HRI对话动态方面的应用。这些模型以自监督学习目标在人人对话数据上训练,无需领域特定微调。我们提出了将这些模型结合使用的方法,用于预测机器人何时应开始准备响应、进行话轮转换以及处理潜在打断情况。我们采用被试内研究设计,使用Furhat机器人与39名成人在对话场景中开展实验,结合大语言模型实现自主响应生成,将所提系统与传统基线系统进行对比。结果显示,参与者显著更偏好所提系统,且该系统大幅减少了响应延迟和打断情况。

英文摘要:

Turn-taking is a fundamental aspect of conversation, but current Human-Robot Interaction (HRI) systems often rely on simplistic, silence-based models, leading to unnatural pauses and interruptions. This paper investigates, for the first time, the application of general turn-taking models, specifically TurnGPT and Voice Activity Projection (VAP), to improve conversational dynamics in HRI. These models are trained on human-human dialogue data using self-supervised learning objectives, without requiring domain-specific fine-tuning. We propose methods for using these models in tandem to predict when a robot should begin preparing responses, take turns, and handle potential interruptions. We evaluated the proposed system in a within-subject study against a traditional baseline system, using the Furhat robot with 39 adults in a conversational setting, in combination with a large language model for autonomous response generation. The results show that participants significantly prefer the proposed system, and it significantly reduces response delays and interruptions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑