机器人别哭:理解对话系统中虚假的拟人化话语
Robots-Dont-Cry: Understanding Falsely Anthropomorphic Utterances in Dialog Systems
摘要:
对话系统通常被设计或训练为输出类似人类的响应。然而,机器可能无法真实地说出某些响应(例如“那部电影让我哭了”)。高度拟人化的反应可能会让用户感到不舒服,或者含蓄地欺骗他们认为他们正在与人类互动。我们收集人类评级的可行性约900两轮对话从9个不同的数据源采样。评级是针对两个假设的机器实施例:未来派人形机器人和数字助理。我们发现,对于通常用于训练对话系统的一些数据源,20-30%的话语不被视为机器可能。额定值受机器实施例的影响很小。我们探讨这些评级的定性和定量原因。最后,我们建立分类器,并探讨如何建模配置可能会影响输出许可,并讨论了建设虚假拟人化的对话系统的影响。
英文摘要:
Dialog systems are often designed or trained to output human-like responses. However, some responses may be impossible for a machine to truthfully say (e.g. "that movie made me cry"). Highly anthropomorphic responses might make users uncomfortable or implicitly deceive them into thinking they are interacting with a human. We collect human ratings on the feasibility of approximately 900 two-turn dialogs sampled from 9 diverse data sources. Ratings are for two hypothetical machine embodiments: a futuristic humanoid robot and a digital assistant. We find that for some data-sources commonly used to train dialog systems, 20-30% of utterances are not viewed as possible for a machine. Rating is marginally affected by machine embodiment. We explore qualitative and quantitative reasons for these ratings. Finally, we build classifiers and explore how modeling configuration might affect output permissibly, and discuss implications for building less falsely anthropomorphic dialog systems.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。