arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2101.04047cs.LGcs.AI
收藏

学习忽略:公平和任务独立的表征

Learning to Ignore: Fair and Task Independent Representations

ZHAW School of Engineering(苏黎世应用科技大学工程学院)

Linda H. Boedi, Helmut Grabner

摘要:

训练公平的机器学习模型,旨在提高其可解释性并解决领域转移问题,在过去几年中引起了人们的极大兴趣。有大量的工作涉及这些主题,主要是在分离。在这项工作中,我们表明,他们可以被看作是一个共同的框架学习不变的表示。表示应该允许预测目标,同时对将数据集分成子组的敏感属性保持不变。我们的方法是基于一个简单的观察,它是不可能的任何学习算法,以区分样本,如果他们有相同的特征表示。这被公式化为一个额外的损失(正则化器),在子组之间强制执行一个共同的特征表示。我们应用它来学习公平模型和解释敏感属性的影响。此外,它可以用于领域自适应,转移知识和学习有效地从很少的例子。在所有的应用中,不仅要学会预测目标,而且要学会忽略什么。

英文摘要:

Training fair machine learning models, aiming for their interpretability and solving the problem of domain shift has gained a lot of interest in the last years. There is a vast amount of work addressing these topics, mostly in separation. In this work we show that they can be seen as a common framework of learning invariant representations. The representations should allow to predict the target while at the same time being invariant to sensitive attributes which split the dataset into subgroups. Our approach is based on the simple observation that it is impossible for any learning algorithm to differentiate samples if they have the same feature representation. This is formulated as an additional loss (regularizer) enforcing a common feature representation across subgroups. We apply it to learn fair models and interpret the influence of the sensitive attribute. Furthermore it can be used for domain adaptation, transferring knowledge and learning effectively from very few examples. In all applications it is essential not only to learn to predict the target, but also to learn what to ignore.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑