arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2408.13167stat.MLcs.LG
收藏

一种用于评估合成数据效用的密度比框架

A density ratio framework for evaluating the utility of synthetic data

Utrecht University(乌得勒支大学);Statistics Netherlands(荷兰统计总局)

Thom Benjamin Volker, Peter-Paul de Wolf, Erik-Jan van Kesteren

AI总结:

本文提出利用密度比估计改进合成数据效用评估,构建了信息丰富且易于解释的全局与局部效用度量,并开发了几乎无需人工调参的估计器,模拟与真实数据应用证明其优于现有方法。

摘要:

合成数据生成是一项很有前景的技术,可以在降低隐私泄露风险的同时促进敏感数据的使用。然而,合成数据若要在下游分析任务中发挥作用,就必须具备足够的质量。目前已有多种衡量合成数据效用的方法,但其结果往往不完整甚至具有误导性。本文提出利用密度比估计来改进合成数据的质量评估,进而提升合成数据集的质量。我们展示了该框架如何与现有度量相关联并在此基础上进行构建,从而产生信息丰富且易于解释的全局和局部效用度量。我们开发了一种估计器,通过自动选择非参数密度比模型,几乎不需要人工调参。通过模拟实验,我们发现与现有方法相比,密度比估计能更准确地估计全局效用。一项真实数据应用展示了密度比如何指导合成模型的改进并用于提升下游分析。我们得出结论,密度比估计是合成数据生成工作流中的宝贵工具,并通过开源R包densityratio提供这些方法。

英文摘要:

Synthetic data generation is a promising technique to facilitate the use of sensitive data while mitigating the risk of privacy breaches. However, for synthetic data to be useful in downstream analysis tasks, it needs to be of sufficient quality. Various methods have been proposed to measure the utility of synthetic data, but their results are often incomplete or even misleading. In this paper, we propose using density ratio estimation to improve quality evaluation for synthetic data, and thereby the quality of synthesized datasets. We show how this framework relates to and builds on existing measures, yielding global and local utility measures that are informative and easy to interpret. We develop an estimator which requires little to no manual tuning due to automatic selection of a nonparametric density ratio model. Through simulations, we find that density ratio estimation yields more accurate estimates of global utility than established procedures. A real-world data application demonstrates how the density ratio can guide refinements of synthesis models and can be used to improve downstream analyses. We conclude that density ratio estimation is a valuable tool in synthetic data generation workflows and provide these methods in the accessible open source R-package densityratio.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑