arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2005.00268cs.CL
收藏

论语言生成中的可控偏向

Towards Controllable Biases in Language Generation

University of Southern California(南加利福尼亚大学);University of California, Los Angeles(加利福尼亚大学洛杉矶分校)

Emily Sheng, Kai-Wei Chang, Premkumar Natarajan, Nanyun Peng

摘要:

我们提出了一个一般的方法对可控的社会偏见在自然语言生成(NLG)。基于对抗性触发器的想法,我们开发了一种方法,当输入提示包含特定人口群体时,在生成的文本中诱导社会偏见。然后我们分析两种情况:1)对一个人口统计学引入负偏差,对另一个人口统计学引入正偏差,以及2)均衡人口统计学之间的偏差。前一种情况使我们能够检测模型中存在的偏差类型。具体来说,我们通过在生成的文本中找到与人口不平等相对应的主题,并比较诱导不同人口统计数据的偏见的相对有效性,来展示我们的方法在促进偏见分析方面的有效性。第二种场景对于减轻下游应用程序(如对话生成)中的偏见很有用。在我们的实验中,缓解技术被证明是有效的,在均衡的人口统计数据的偏见量,同时产生较少的负面偏见的文本整体。

英文摘要:

We present a general approach towards controllable societal biases in natural language generation (NLG). Building upon the idea of adversarial triggers, we develop a method to induce societal biases in generated text when input prompts contain mentions of specific demographic groups. We then analyze two scenarios: 1) inducing negative biases for one demographic and positive biases for another demographic, and 2) equalizing biases between demographics. The former scenario enables us to detect the types of biases present in the model. Specifically, we show the effectiveness of our approach at facilitating bias analysis by finding topics that correspond to demographic inequalities in generated text and comparing the relative effectiveness of inducing biases for different demographics. The second scenario is useful for mitigating biases in downstream applications such as dialogue generation. In our experiments, the mitigation technique proves to be effective at equalizing the amount of biases across demographics while simultaneously generating less negatively biased text overall.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑