Testing whether a sample survey is a credible representation of the population is an important question to ensure the validity of any downstream research. While this problem, in general, does not have an efficient solution, one might take a task-based approach and aim to understand whether a certain data analysis tool, like linear regression, would yield similar answers both on the population and the sample survey. In this paper, we design an algorithm to test the credibility of a sample survey in terms of linear regression. In other words, we design an algorithm that can certify if a sample survey is good enough to guarantee the correctness of data analysis done using linear regression tools. Nowadays, one is naturally concerned about data privacy in surveys. Thus, we further test the credibility of surveys published in a differentially private manner. Specifically, we focus on Local Differential Privacy (LDP), which is a standard technique to ensure privacy in surveys where the survey participants might not trust the aggregator. We extend our algorithm to work even when the data analysis has been done using surveys with LDP. In the process, we also propose an algorithm that learns with high probability the guarantees a linear regression model on a survey published with LDP. Our algorithm also serves as a mechanism to learn linear regression models from data corrupted with noise coming from any subexponential distribution. We prove that it achieves the optimal estimation error bound for $\ell_1$ linear regression, which might be of broader interest. We prove the theoretical correctness of our algorithms while trying to reduce the sample complexity for both public and private surveys. We also numerically demonstrate the performance of our algorithms on real and synthetic datasets.
How to Democratise and Protect AI: Fair and Differentially Private Decentralised Deep Learning
National University of Singapore(新加坡国立大学);The University of Melbourne(墨尔本大学);IBM Singapore Lab(IBM新加坡实验室);Monash University(莫纳什大学);Deakin University(迪肯大学)
On the Inherent Privacy Amplification of Missing Data
Sorbonne Université(索邦大学);Université Paris Cité(巴黎城市大学);CNRS(国家科学研究中心);Laboratoire de Probabilités, Statistique et Modélisation(概率、统计与建模实验室);LPSM(LPSM实验室)
Georgia Institute of Technology(佐治亚理工学院);University of Richmond(里士满大学);Academy of Mathematics and Systems Science, Chinese Academy of Sciences(中国科学院数学与系统科学研究院)