In this paper, we present a methodology for the development of embodied conversational agents for social virtual worlds. The agents provide multimodal communication with their users in which speech interaction is included. Our proposal combines different techniques related to Artificial Intelligence, Natural Language Processing, Affective Computing, and User Modeling. Firstly, the developed conversational agents. A statistical methodology has been developed to model the system conversational behavior, which is learned from an initial corpus and improved with the knowledge acquired from the successive interactions. In addition, the selection of the next system response is adapted considering information stored into users profiles and also the emotional contents detected in the users utterances. Our proposal has been evaluated with the successful development of an embodied conversational agent which has been placed in the Second Life social virtual world. The avatar includes the different models and interacts with the users who inhabit the virtual world in order to provide academic information. The experimental results show that the agents conversational behavior adapts successfully to the specific characteristics of users interacting in such environments.
Towards Scalable Multi-domain Conversational Agents: The Schema-Guided Dialogue Dataset
Google Research(谷歌研究院)
Google Assistant、Alexa和Siri等虚拟助理为跨多个域的大量服务和API提供对话界面。这样的系统需要支持不断增加的服务数量,这些服务可能具有重叠的功能。此外,这些服务中的一些服务几乎没有可用的训练数据。现有的面向任务的对话的公共数据集不足以捕捉这些挑战,因为它们覆盖几个领域,并假设每个域的一个静态本体。在这项工作中,我们介绍了模式引导对话(SGD)数据集,包含超过16k的多域会话跨越16个域。我们的数据集在规模上超过了现有的面向任务的对话语料库,同时也突出了与构建大规模虚拟助手相关的挑战。它为许多任务提供了一个具有挑战性的测试平台,包括语言理解、槽填充、对话状态跟踪和响应生成。沿着同样的思路,我们提出了一个模式引导的范式为任务导向的对话,其中预测的意图和插槽,作为输入,使用他们的自然语言描述的动态设置。这允许单个对话系统容易地支持大量服务,并且便于新服务的简单集成,而不需要额外的训练数据。基于所提出的范例,我们发布了一个对话状态跟踪模型,能够zero-shot推广到新的API,同时在常规设置中保持竞争力。
Acoustic and Facial Markers of Perceived Conversational Success in Spontaneous Speech
Department of Electrical and Computer Engineering, University of Maryland College Park, MD, USA(电气与计算机工程系,马里兰大学学院市分校);Department of Psychology, University of Maryland College Park, MD, USA(心理学系,马里兰大学学院市分校)
AutoMedic: An Automated Evaluation Framework for Clinical Conversational Agents with Medical Dataset Grounding
Yonsei University College of Medicine(延世大学医学院);Yonsei Institute for Digital Health(延世大学数字健康研究所);Yonsei University(延世大学);Institute of Behavioral Sciences in Medicine(医学行为科学研究所)