发表机构
Tongji University; Grinnell College; Hunan University; Southern University of Science and Technology（同济大学; 格林内尔学院; 湖南大学; 南方科技大学）
机构由 AI 辅助整理，请以论文原文为准。AI 中文总结
本研究通过观察和设计工作坊探索语音代理与画布交互的设计空间，开发了VoCa代理，并通过18人五天的部署验证了其在学习、工作和日常生活中的应用潜力与协调挑战。
AI 中文摘要
人们在说话时会同时书写和涂画，以共同解释、组织和发展内容。受这些实践的启发，我们研究了语音代理如何在多轮对话中与用户一起使用画布辅助语音。我们进行了一项由两部分组成的形成性研究：一项观察性研究，考察成对参与者如何协调语音与白板工作；随后是一个设计工作坊，为语音-画布交互定义了一个设计空间。基于这些见解，我们开发了VoCa，一个协调语音与视觉对象创建、注释和注意力引导的语音代理。一项为期五天、有18名参与者参与的部署研究考察了可用性、语音-画布交互体验、使用模式以及期望的改进。参与者的体验突出了语音-画布交互在学习、工作和日常生活中的机会，同时也指出了在协调代理所说内容与所展示内容方面存在的挑战，这些内容需要用户能够跟随并施加影响。这些发现为语音代理如何在对话中利用画布辅助语音提供了启示。
英文摘要
People write and sketch while speaking to explain, organize, and develop content together. Inspired by these practices, we investigate how voice agents can use a canvas alongside speech in multi-turn conversations with users. We conducted a two-part formative study: an observational study of how pairs coordinated speech and boardwork, followed by a design workshop that informed a design space for speech-canvas interaction with voice agents. Building on these insights, we developed VoCa, a voice agent that coordinates speech with visual object creation, annotation, and attention guidance. A five-day deployment with 18 participants examined usability, experiences of speech-canvas interaction, patterns of use, and desired improvements. Participants' experiences highlighted opportunities for speech-canvas interaction in learning, work, and daily life, alongside challenges in coordinating what agents say and show in ways users can follow and influence. These findings inform how voice agents can use a canvas alongside speech in conversation.
Comments22 pages, 11 figures, 5 tables
