arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2504.08440cs.HC

语音命令 + 语音情感:探索情感语音命令作为一种复合且富有趣味的模态

Speech Command + Speech Emotion: Exploring Emotional Speech Commands as a Compound and Playful Modality

Ilhan Aslan, Timothy Merritt, Stine S. Johansen, Niels van Berkel

AI总结:

本文通过原型游戏和用户研究(N=14)探索语音情感命令对智能体交互的影响,发现利用语音情感调整执行行为可显著改变用户的刺激性与可靠性感知,并提出相关设计启示及“配音式表演”概念。

摘要:

在人机交互日益走向智能体化 AI 系统的时代,这些系统能够以对话方式与用户建立联系,语音因此成为向智能体下达命令的重要模态。通过识别并利用语音情感(即命令是如何被说出的),我们可以让智能体具备在情感上强化其回应、并在社会层面丰富用户感知与体验的能力。为探索语音情感命令的概念及其对用户感知的影响,我们实现了一个原型,并进行了一项用户研究(N = 14),在该研究中,语音命令被用于在一个极简复古游戏风格的实现中操控两辆载具。虽然两个智能体都会执行用户命令,但只有一个智能体会利用语音情感信息来调整其执行行为。我们报告了用户对每个智能体感知上的差异,包括在刺激性和可靠性方面的显著差异,概述了利用情感语音命令设计智能体交互的启示,并提供了关于用户如何有意识地表达情感的见解,我们将这种现象描述为“配音式表演”。

英文摘要:

In an era of human-computer interaction with increasingly agentic AI systems capable of connecting with users conversationally, speech is an important modality for commanding agents. By recognizing and using speech emotions (i.e., how a command is spoken), we can provide agents with the ability to emotionally accentuate their responses and socially enrich users' perceptions and experiences. To explore the concept and impact of speech emotion commands on user perceptions, we realized a prototype and conducted a user study (N = 14) where speech commands are used to steer two vehicles in a minimalist and retro game style implementation. While both agents execute user commands, only one of the agents uses speech emotion information to adapt its execution behavior. We report on differences in how users perceived each agent, including significant differences in stimulation and dependability, outline implications for designing interactions with agents using emotional speech commands, and provide insights on how users consciously emote, which we describe as "voice acting".

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑