arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2104.03007cs.LGstat.ML
收藏

代表性和公平的合成数据

Representative & Fair Synthetic Data

MOSTLY AI

Paul Tiwald, Alexandra Ebert, Daniel T. Soukup

摘要:

算法基于它们所接触的训练数据来学习规则和关联。然而,教机器理解和预测世界的相同数据包含社会和历史偏见,导致有偏见的算法,一旦用于决策支持,就有进一步放大这些偏见的风险。另一方面,合成数据的出现,承诺提供无限量的代表性,现实的训练样本,可以进一步共享,而不会泄露个人受试者的隐私。我们提出了一个框架,将公平性约束到自监督学习过程中,允许然后模拟无限数量的代表以及公平的合成数据。这个框架提供了一个把手来管理和控制隐私以及人工智能内部的偏见,就在它的源头:训练数据。我们通过修改现有的生成模型架构并生成具有代表性的公平版本的UCI成人人口普查数据集来演示所提出的方法。虽然属性之间的关系被忠实地保留,但原始数据中固有的性别和种族偏见得到了控制。这通过比较在原始数据上训练的下游预测模型与公平的合成数据的倾向分数来进一步验证。我们认为代表性和公平的合成数据是一个有前途的未来构建块,不是在历史世界上教授算法,而是在我们努力生活的世界上。

英文摘要:

Algorithms learn rules and associations based on the training data that they are exposed to. Yet, the very same data that teaches machines to understand and predict the world, contains societal and historic biases, resulting in biased algorithms with the risk of further amplifying these once put into use for decision support. Synthetic data, on the other hand, emerges with the promise to provide an unlimited amount of representative, realistic training samples, that can be shared further without disclosing the privacy of individual subjects. We present a framework to incorporate fairness constraints into the self-supervised learning process, that allows to then simulate an unlimited amount of representative as well as fair synthetic data. This framework provides a handle to govern and control for privacy as well as for bias within AI at its very source: the training data. We demonstrate the proposed approach by amending an existing generative model architecture and generating a representative as well as fair version of the UCI Adult census data set. While the relationships between attributes are faithfully retained, the gender and racial biases inherent in the original data are controlled for. This is further validated by comparing propensity scores of downstream predictive models that are trained on the original data versus the fair synthetic data. We consider representative & fair synthetic data a promising future building block to teach algorithms not on historic worlds, but rather on the worlds that we strive to live in.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑