arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.04823cs.LG
收藏

你的合成数据有多真实?约束表格数据的深度生成模型

How Realistic Is Your Synthetic Data? Constraining Deep Generative Models for Tabular Data

University of Luxembourg(卢森堡大学);Vienna University of Technology(维也纳技术大学);University of Oxford(牛津大学)

Mihaela Cătălina Stoian, Salijona Dyrmishi, Maxime Cordy, Thomas Lukasiewicz, Eleonora Giunchiglia

AI总结:

本文提出约束深度生成模型(C-DGMs),通过自动解析约束并集成约束层,确保表格数据生成符合背景知识,实验显示违规率从超95%降至零,效用提升达6.5%。

摘要:

深度生成模型(DGMs)已被证明是生成表格数据的强大工具,因为它们越来越能够捕捉表征这些数据的复杂分布。然而,要生成真实的合成数据,仅仅对数据分布进行良好的近似往往是不够的,因为这还需要符合编码了问题相关基本背景知识的约束条件。在本文中,我们解决了这一局限性,并展示了如何将用于表格数据的DGMs转化为约束深度生成模型(C-DGMs),其生成的样本保证符合给定的约束条件。这是通过自动解析约束并将其转化为与DGM无缝集成的约束层(CL)来实现的。我们使用各种DGMs和任务进行的广泛实验分析表明,标准DGMs经常违反约束,其中一些的违规率超过95%,而相应的C-DGMs则从不违规。然后,我们定量证明,在训练时,C-DGMs能够利用约束所表达的背景知识,在效用和检测方面比其标准对应模型提升高达6.5%。此外,我们展示了我们的CL不一定需要在训练时集成,因为它也可以在推理时用作护栏,仍然能在模型的整体性能上产生一些改进。最后,我们展示了我们的CL不会阻碍模型的样本生成时间。

英文摘要:

Deep Generative Models (DGMs) have been shown to be powerful tools for generating tabular data, as they have been increasingly able to capture the complex distributions that characterize them. However, to generate realistic synthetic data, it is often not enough to have a good approximation of their distribution, as it also requires compliance with constraints that encode essential background knowledge on the problem at hand. In this paper, we address this limitation and show how DGMs for tabular data can be transformed into Constrained Deep Generative Models (C-DGMs), whose generated samples are guaranteed to be compliant with the given constraints. This is achieved by automatically parsing the constraints and transforming them into a Constraint Layer (CL) seamlessly integrated with the DGM. Our extensive experimental analysis with various DGMs and tasks reveals that standard DGMs often violate constraints, some exceeding $95\%$ non-compliance, while their corresponding C-DGMs are never non-compliant. Then, we quantitatively demonstrate that, at training time, C-DGMs are able to exploit the background knowledge expressed by the constraints to outperform their standard counterparts with up to $6.5\%$ improvement in utility and detection. Further, we show how our CL does not necessarily need to be integrated at training time, as it can be also used as a guardrail at inference time, still producing some improvements in the overall performance of the models. Finally, we show that our CL does not hinder the sample generation time of the models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑