检测和扰动:通过基于顺应性的解码对有偏见和敏感文本进行中性重写
Detect and Perturb: Neutral Rewriting of Biased and Sensitive Text via Gradient-based Decoding
摘要:
书面语言带有显性和隐性的偏见,可以分散有意义的信号。例如,推荐信可能对男性和女性候选人的描述不同,或者他们的写作风格可能间接揭示人口特征。在最好的情况下,这种偏见会分散文本的有意义的内容;在最坏的情况下,它们会导致不公平的结果。我们调查的挑战,重新生成的输入句子,以“中和”敏感属性,同时保持原始文本的语义(例如,候选人合格?)。我们提出了一个基于梯度的重写框架,检测和扰动,以中和(DEPEN),首先检测敏感组件和屏蔽它们的再生,然后在解码时扰动生成模型的中和约束下,推动(预测)敏感属性的分布朝向均匀分布。我们在两个不同的情况下的实验表明,DEPEN可以重新生成流畅的替代品是中立的敏感属性,同时保持其他属性的语义。
英文摘要:
Written language carries explicit and implicit biases that can distract from meaningful signals. For example, letters of reference may describe male and female candidates differently, or their writing style may indirectly reveal demographic characteristics. At best, such biases distract from the meaningful content of the text; at worst they can lead to unfair outcomes. We investigate the challenge of re-generating input sentences to 'neutralize' sensitive attributes while maintaining the semantic meaning of the original text (e.g. is the candidate qualified?). We propose a gradient-based rewriting framework, Detect and Perturb to Neutralize (DEPEN), that first detects sensitive components and masks them for regeneration, then perturbs the generation model at decoding time under a neutralizing constraint that pushes the (predicted) distribution of sensitive attributes towards a uniform distribution. Our experiments in two different scenarios show that DEPEN can regenerate fluent alternatives that are neutral in the sensitive attribute while maintaining the semantics of other attributes.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。