A Systematic and Formal Study of the Impact of Local Differential Privacy on Fairness: Preliminary Results
INRIA(法国国家信息与自动化研究所);École Polytechnique(巴黎综合理工学院);IPP(IPP机构);Mathematical Institute of the Serbian Academy of Sciences and Arts(塞尔维亚科学院数学研究所);Inria Centre at the University Grenoble Alpes(格勒诺布尔大学Inria中心)
Karima Makhlouf, Tamara Stefanovic, Heber H. Arcolezi, Catuscia Palamidessi
Machine learning (ML) algorithms rely primarily on the availability of training data, and, depending on the domain, these data may include sensitive information about the data providers, thus leading to significant privacy issues. Differential privacy (DP) is the predominant solution for privacy-preserving ML, and the local model of DP is the preferred choice when the server or the data collector are not trusted. Recent experimental studies have shown that local DP can impact ML prediction for different subgroups of individuals, thus affecting fair decision-making. However, the results are conflicting in the sense that some studies show a positive impact of privacy on fairness while others show a negative one. In this work, we conduct a systematic and formal study of the effect of local DP on fairness. Specifically, we perform a quantitative study of how the fairness of the decisions made by the ML model changes under local DP for different levels of privacy and data distributions. In particular, we provide bounds in terms of the joint distributions and the privacy level, delimiting the extent to which local DP can impact the fairness of the model. We characterize the cases in which privacy reduces discrimination and those with the opposite effect. We validate our theoretical findings on synthetic and real-world datasets. Our results are preliminary in the sense that, for now, we study only the case of one sensitive attribute, and only statistical disparity, conditional statistical disparity, and equal opportunity difference.
Towards Collaborative Fairness in Federated Learning Under Imbalanced Covariate Shift
The Pennsylvania State University(宾夕法尼亚州立大学);State University of New York at Albany(纽约州立大学阿尔巴尼分校);University of Minnesota Twin Cities(明尼苏达大学双城分校);Dalian University of Technology(大连理工大学)
Uncovering Fairness through Data Complexity as an Early Indicator
Data Science and Computational Intelligence Institute (DaSCI), University of Granada(格拉纳达大学数据科学与计算智能研究所);University of Bergen(卑尔根大学);Department of Computer Science and Artificial Intelligence (DECSAI), University of Granada(格拉纳达大学计算机科学与人工智能系)
Towards a Formal Creativity Theory: Preliminary results in Novelty and Transformativeness
University of Coimbra(科英布拉大学);Vrije Universiteit Brussel(布鲁塞尔自由大学);Queen Mary University of London(伦敦大学玛丽皇后学院);Centre for Informatics and Systems (CISUC)(信息学与系统中心(CISUC))
The invisible power of fairness. How machine learning shapes democracy
Nexa Center for Internet & Society, DAUIN, Politecnico di Torino(都灵理工大学Nexa互联网与社会中心、DAUIN);Future Urban Legacy Lab, Politecnico di Torino(都灵理工大学未来城市遗产实验室);Fondazione Bruno Kessler(布鲁诺·凯斯勒基金会)