arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2410.05458cs.LGcs.CRstat.MEstat.ML
收藏

通过回归视角检验公开与私密调查的可信度

Testing Credibility of Public and Private Surveys through the Lens of Regression

Univ. Lille(里尔大学);Inria(法国国家信息与自动化研究所);CNRS(法国国家科学研究中心);Centrale Lille(里尔中央理工学院);Indian Statistical Institute(印度统计研究所)

Debabrota Basu, Sourav Chakraborty, Debarshi Chanda, Buddha Dev Das, Arijit Ghosh, Arnab Ray

AI总结:

本研究提出一种从线性回归角度检验抽样调查可信度的算法,并将其扩展至本地差分隐私(LDP)调查场景,该算法可从次指数噪声数据中学习回归模型,达到ℓ₁线性回归最优估计误差界,同时降低样本复杂度,经真实与合成数据集验证有效。

摘要:

检验抽样调查是否能可信地代表总体,是确保所有下游研究有效性的重要问题。尽管该问题通常不存在高效解法,但研究者可采用基于任务的思路,探究线性回归等特定数据分析工具在总体和抽样调查上是否会得出相似结果。本文设计了一种算法,用于从线性回归角度检验抽样调查的可信度,换言之,该算法可证明抽样调查是否足以保证使用线性回归工具开展的数据分析的正确性。\n如今,人们自然会关注调查中的数据隐私问题,因此我们进一步检验了以差分隐私方式发布的调查的可信度。具体而言,我们聚焦于本地差分隐私(Local Differential Privacy, LDP)——这是在调查参与者可能不信任聚合方的场景下,保障调查隐私的标准技术。我们将算法扩展,使其可适用于基于LDP调查完成的数据分析场景。在此过程中,我们还提出了一种算法,能以高概率获知在LDP发布的调查上训练的线性回归模型的性能保证。我们的算法还可作为一种机制,用于从受任意次指数分布噪声污染的数据中学习线性回归模型。我们证明该算法在$\u2113_1$线性回归任务中达到了最优估计误差界,这一结论可能具有更广泛的研究价值。我们证明了算法的理论正确性,同时致力于降低公开调查和私密调查的样本复杂度。此外,我们还在真实数据集和合成数据集上通过数值实验验证了算法的性能。

英文摘要:

Testing whether a sample survey is a credible representation of the population is an important question to ensure the validity of any downstream research. While this problem, in general, does not have an efficient solution, one might take a task-based approach and aim to understand whether a certain data analysis tool, like linear regression, would yield similar answers both on the population and the sample survey. In this paper, we design an algorithm to test the credibility of a sample survey in terms of linear regression. In other words, we design an algorithm that can certify if a sample survey is good enough to guarantee the correctness of data analysis done using linear regression tools. Nowadays, one is naturally concerned about data privacy in surveys. Thus, we further test the credibility of surveys published in a differentially private manner. Specifically, we focus on Local Differential Privacy (LDP), which is a standard technique to ensure privacy in surveys where the survey participants might not trust the aggregator. We extend our algorithm to work even when the data analysis has been done using surveys with LDP. In the process, we also propose an algorithm that learns with high probability the guarantees a linear regression model on a survey published with LDP. Our algorithm also serves as a mechanism to learn linear regression models from data corrupted with noise coming from any subexponential distribution. We prove that it achieves the optimal estimation error bound for $\ell_1$ linear regression, which might be of broader interest. We prove the theoretical correctness of our algorithms while trying to reduce the sample complexity for both public and private surveys. We also numerically demonstrate the performance of our algorithms on real and synthetic datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑