arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.12945cs.LGstat.ML
收藏

表格数据生成模型:深度调研与广泛调优下的性能基准测试

Tabular Data Generation Models: An In-Depth Survey and Performance Benchmarks with Extensive Tuning

Univ Rennes, IUF, Inria, CNRS, IRISA(里昂大学、IUF、Inria、CNRS、IRISA);Orange Labs(Orange实验室)

G. Charbel N. Kindji, Lina Maria Rojas-Barahona, Elisa Fromont, Tanguy Urvoy

AI总结:

本文对表格数据生成模型进行深度调研,在16个数据集上广泛评估了五种模型家族,发现针对特定数据集的大规模调优显著提升性能,且基于扩散的模型在同等GPU预算下优势并不显著。

摘要:

训练生成真实、安全且有用的表格数据的生成模型,对于数据隐私、插补、过采样、可解释性或模拟至关重要。然而,由于表格数据的异构性、非平滑分布、复杂依赖关系和不平衡的分类特征,生成表格数据并非易事。尽管文献中提出了多种方法,但仍需在相同条件下对多种数据集进行统一评估。本研究通过充分考虑超参数、特征编码和架构的优化来满足这一需求。我们通过在16个数据集上的广泛基准测试,探究了针对特定数据集的调优对五个最新表格数据生成模型家族的影响。这些数据集在规模(平均80,000行)、数据类型和领域上各不相同。我们还为每个模型提出了一个缩减的搜索空间,允许快速优化,以显著更低的成本实现近乎等效的性能。我们的基准测试表明,对于大多数模型,与原始配置相比,大规模的针对特定数据集的调优显著提升了性能。此外,我们确认基于扩散的模型在表格数据上通常优于其他模型。然而,当整个调优和训练过程被限制在相同的GPU预算内时,这一优势并不显著。

英文摘要:

The ability to train generative models that produce realistic, safe and useful tabular data is essential for data privacy, imputation, oversampling, explainability or simulation. However, generating tabular data is not straightforward due to its heterogeneity, non-smooth distributions, complex dependencies and imbalanced categorical features. Although diverse methods have been proposed in the literature, there is a need for a unified evaluation, under the same conditions, on a variety of datasets. This study addresses this need by fully considering the optimization of: hyperparameters, feature encodings, and architectures. We investigate the impact of dataset-specific tuning on five recent model families for tabular data generation through an extensive benchmark on 16 datasets. These datasets vary in terms of size (an average of 80,000 rows), data types, and domains. We also propose a reduced search space for each model that allows for quick optimization, achieving nearly equivalent performance at a significantly lower cost. Our benchmark demonstrates that, for most models, large-scale dataset-specific tuning substantially improves performance compared to the original configurations. Furthermore, we confirm that diffusion-based models generally outperform other models on tabular data. However, this advantage is not significant when the entire tuning and training process is restricted to the same GPU budget.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑