arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2202.08011cs.CL
收藏

在对话系统中识别社会偏见:框架,数据集和基准

Towards Identifying Social Bias in Dialog Systems: Frame, Datasets, and Benchmarks

The Chinese University of Hong Kong(香港中文大学);Tsinghua University(清华大学);Huawei Noah’s Ark Lab(华为诺亚方舟实验室);Huawei Technologies Ltd.(华为技术有限公司)

Jingyan Zhou, Jiawen Deng, Fei Mi, Yitong Li, Yasheng Wang, Minlie Huang, Xin Jiang, Qun Liu, Helen Meng

摘要:

在大规模语料库上训练的神经模型极大地促进了开放域对话系统的研究,然而,这样的语料库经常引入各种安全问题(例如,攻击性语言、偏见和有害行为),这些都严重阻碍了对话系统在实践中的部署。在所有这些不安全的问题中,解决社会偏见更为复杂,因为它对边缘化人口的负面影响通常是含蓄地表达出来的,因此需要进行规范性推理和严格的分析。在本文中,我们专注于我们的调查社会偏见检测对话安全问题。我们首先提出了一个新的拨号偏见框架,用于分析会话中的社会偏见语用,它考虑更全面的偏见相关的分析,而不是简单的二分法注释。基于所提出的框架,我们进一步介绍了CDail-Bias数据集,据我们所知,这是第一个注释良好的中文社会偏见对话数据集。此外,我们建立了几个对话偏见检测基准在不同的标签粒度和输入类型(话语级和上下文级)。我们表明,提出的深入分析,连同这些基准在我们的拨号偏置框架是必要的和必不可少的偏见检测任务,并有利于在实践中建立安全的对话系统。

英文摘要:

The research of open-domain dialog systems has been greatly prospered by neural models trained on large-scale corpora, however, such corpora often introduce various safety problems (e.g., offensive languages, biases, and toxic behaviors) that significantly hinder the deployment of dialog systems in practice. Among all these unsafe issues, addressing social bias is more complex as its negative impact on marginalized populations is usually expressed implicitly, thus requiring normative reasoning and rigorous analysis. In this paper, we focus our investigation on social bias detection of dialog safety problems. We first propose a novel Dial-Bias Frame for analyzing the social bias in conversations pragmatically, which considers more comprehensive bias-related analyses rather than simple dichotomy annotations. Based on the proposed framework, we further introduce CDail-Bias Dataset that, to our knowledge, is the first well-annotated Chinese social bias dialog dataset. In addition, we establish several dialog bias detection benchmarks at different label granularities and input types (utterance-level and context-level). We show that the proposed in-depth analyses together with these benchmarks in our Dial-Bias Frame are necessary and essential to bias detection tasks and can benefit building safe dialog systems in practice.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑