arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2006.08795cs.LGstat.ML
收藏

平衡是关键:私人中位数分裂产生高效用的随机树

Balance is key: Private median splits yield high-utility random trees

The University of Texas at Austin(德克萨斯大学奥斯汀分校)

Shorya Consul, Sinead A. Williamson

摘要:

随机森林由于其通用性而成为分类和回归的流行方法。然而,这种灵活性可能会以用户隐私为代价,因为训练随机森林需要多个数据查询,通常是在训练数据的小的、可识别的子集上。私有化这些查询通常会带来很高的效用成本,这在很大程度上是因为我们正在对数据的小子集进行私有化查询,这些子集很容易被添加的噪声破坏。在本文中,我们提出了DiPriMe森林,一种新的基于树的集成方法,用于差分私有回归和分类,适用于真实或分类协变量。我们使用差异私有版本的中位数生成分裂,这鼓励平衡的叶节点。通过避免低占用率的叶节点,我们避免了高信噪比时,私有化的叶节点足够的统计。我们从理论上和经验表明,所得到的算法具有很高的实用性,同时确保差分隐私。

英文摘要:

Random forests are a popular method for classification and regression due to their versatility. However, this flexibility can come at the cost of user privacy, since training random forests requires multiple data queries, often on small, identifiable subsets of the training data. Privatizing these queries typically comes at a high utility cost, in large part because we are privatizing queries on small subsets of the data, which are easily corrupted by added noise. In this paper, we propose DiPriMe forests, a novel tree-based ensemble method for differentially private regression and classification, which is appropriate for real or categorical covariates. We generate splits using a differentially private version of the median, which encourages balanced leaf nodes. By avoiding low occupancy leaf nodes, we avoid high signal-to-noise ratios when privatizing the leaf node sufficient statistics. We show theoretically and empirically that the resulting algorithm exhibits high utility, while ensuring differential privacy.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑