arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1909.04387cs.HCcs.CL
收藏

基于群体的会话主体虐待反应策略评价

A Crowd-based Evaluation of Abuse Response Strategies in Conversational Agents

Heriot-Watt University(赫瑞-瓦特大学)

Amanda Cercas Curry, Verena Rieser

摘要:

会话代理人应该如何通过用户对言语虐待做出反应?为了回答这个问题,我们对当前最先进的系统所采用的滥用响应策略进行了大规模的众包评估。我们的研究结果表明,一些策略,如“礼貌拒绝”得分很高,而对于其他策略的人口因素,如年龄,以及严重程度的前虐待影响用户的看法,其中的反应是适当的。此外,我们发现,大多数数据驱动的模型落后于基于规则的或商业系统在其感知的适当性。

英文摘要:

How should conversational agents respond to verbal abuse through the user? To answer this question, we conduct a large-scale crowd-sourced evaluation of abuse response strategies employed by current state-of-the-art systems. Our results show that some strategies, such as "polite refusal" score highly across the board, while for other strategies demographic factors, such as age, as well as the severity of the preceding abuse influence the user's perception of which response is appropriate. In addition, we find that most data-driven models lag behind rule-based or commercial systems in terms of their perceived appropriateness.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑