arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2210.06280cs.LG
收藏

语言模型是逼真的表格数据生成器

Language Models are Realistic Tabular Data Generators

University of Tübingen(蒂宾根大学);Technical University of Munich(慕尼黑工业大学)

Vadim Borisov, Kathrin Seßler, Tobias Leemann, Martin Pawelczyk, Gjergji Kasneci

AI总结:

本文提出 GReaT,利用自回归 LLM 生成逼真表格数据,并支持以任意特征子集为条件、无额外开销采样其余特征,实验表明其在多类数据集上达到最先进性能。

摘要:

表格数据是最古老且最普遍存在的数据形式之一。然而,生成具有原始数据特征的合成样本,对于表格数据而言仍然是一项重大挑战。尽管来自计算机视觉领域的许多生成模型(例如变分自编码器或生成对抗网络)已被改造用于表格数据生成,但较少研究关注近期基于 transformer 的大型语言模型(LLM),而它们本质上同样具有生成性。为此,我们提出 GReaT(Generation of Realistic Tabular data,逼真表格数据生成),该方法利用自回归生成式 LLM 来采样合成但高度逼真的表格数据。此外,GReaT 可以通过以任意特征子集为条件来建模表格数据分布;其余特征无需额外开销即可完成采样。我们在一系列实验中证明了所提方法的有效性,这些实验从多个角度量化了所生成数据样本的有效性和质量。我们发现,在众多具有异构特征类型、规模各异的真实和合成数据集上,GReaT 均保持最先进性能。

英文摘要:

Tabular data is among the oldest and most ubiquitous forms of data. However, the generation of synthetic samples with the original data's characteristics remains a significant challenge for tabular data. While many generative models from the computer vision domain, such as variational autoencoders or generative adversarial networks, have been adapted for tabular data generation, less research has been directed towards recent transformer-based large language models (LLMs), which are also generative in nature. To this end, we propose GReaT (Generation of Realistic Tabular data), which exploits an auto-regressive generative LLM to sample synthetic and yet highly realistic tabular data. Furthermore, GReaT can model tabular data distributions by conditioning on any subset of features; the remaining features are sampled without additional overhead. We demonstrate the effectiveness of the proposed approach in a series of experiments that quantify the validity and quality of the produced data samples from multiple angles. We find that GReaT maintains state-of-the-art performance across numerous real-world and synthetic data sets with heterogeneous feature types coming in various sizes.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑