arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.18013cs.LG
收藏

自监督改进用于表格数据插补的扩散模型

Self-Supervision Improves Diffusion Models for Tabular Data Imputation

Monash University(莫纳什大学);Amazon(亚马逊公司)

Yixin Liu, Thalaiyasingam Ajanthan, Hisham Husain, Vu Nguyen

AI总结:

本文提出自监督插补扩散模型SimpDM,通过自监督对齐机制减轻对初始化噪声的敏感性,并引入状态相关数据增强策略提升有限数据下的鲁棒性,在表格数据插补任务中达到或超越现有最先进方法。

摘要:

缺失数据的普遍性引发了对表格数据插补方法的广泛关注。扩散模型作为数据生成的尖端技术,在表格数据插补任务中展现出巨大潜力。然而,为了追求多样性,普通扩散模型通常对初始化噪声表现出敏感性,这阻碍了模型生成稳定且准确的插补结果。此外,表格数据固有的稀疏性给扩散模型准确建模数据流形带来了挑战,影响了这些模型在数据插补上的鲁棒性。为了应对这些挑战,本文提出了一种名为自监督插补扩散模型(简称SimpDM)的先进扩散模型,专门为表格数据插补任务量身定制。为了减轻对噪声的敏感性,我们引入了一种自监督对齐机制,旨在正则化模型,确保插补预测的一致性和稳定性。此外,我们在SimpDM中引入了一种精心设计的状态相关数据增强策略,提升了扩散模型在处理有限数据时的鲁棒性。大量实验表明,SimpDM在各种场景下均达到或超越了最先进的插补方法。

英文摘要:

The ubiquity of missing data has sparked considerable attention and focus on tabular data imputation methods. Diffusion models, recognized as the cutting-edge technique for data generation, demonstrate significant potential in tabular data imputation tasks. However, in pursuit of diversity, vanilla diffusion models often exhibit sensitivity to initialized noises, which hinders the models from generating stable and accurate imputation results. Additionally, the sparsity inherent in tabular data poses challenges for diffusion models in accurately modeling the data manifold, impacting the robustness of these models for data imputation. To tackle these challenges, this paper introduces an advanced diffusion model named Self-supervised imputation Diffusion Model (SimpDM for brevity), specifically tailored for tabular data imputation tasks. To mitigate sensitivity to noise, we introduce a self-supervised alignment mechanism that aims to regularize the model, ensuring consistent and stable imputation predictions. Furthermore, we introduce a carefully devised state-dependent data augmentation strategy within SimpDM, enhancing the robustness of the diffusion model when dealing with limited data. Extensive experiments demonstrate that SimpDM matches or outperforms state-of-the-art imputation methods across various scenarios.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑