arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.11501cs.LGcs.AI
收藏

Diff-MTS:面向大模型时代的基于时间增强条件扩散的工业时间序列AIGC

Diff-MTS: Temporal-Augmented Conditional Diffusion-based AIGC for Industrial Time Series Towards the Large Model Era

School of Automation Science and Electrical Engineering, Beihang University(北京航空航天大学自动化科学与电气工程学院)

Lei Ren, Haiteng Wang, Yuanjun Laili

AI总结:

本文提出Diff-MTS,一种时间增强的条件自适应扩散模型,通过Ada-MMD和TDR-UNet解决工业多元时间序列生成中GAN训练不稳定及时间依赖建模问题,在C-MAPSS和FEMTO数据集上显著优于GAN方法。

摘要:

工业多元时间序列(MTS)是工业领域中人们理解机器状态的关键视图。然而,由于数据采集困难和隐私问题,可用于构建工业智能和工业大模型的可用数据远不充足。因此,工业时间序列数据生成具有重要意义。现有研究通常应用生成对抗网络(GANs)来生成MTS。然而,由于生成器和判别器的联合训练,GANs存在训练过程不稳定的问题。本文提出了一种时间增强的条件自适应扩散模型,称为Diff-MTS,用于MTS生成。它旨在更好地处理MTS数据复杂的时间依赖性和动态特性。具体而言,提出了一种条件自适应最大均值差异(Ada-MMD)方法用于MTS的受控生成,该方法不需要分类器来控制生成过程。它提高了扩散模型的条件一致性。此外,建立了一个时间分解重建UNet(TDR-UNet)来捕获复杂的时间模式,并进一步提高合成时间序列的质量。在C-MAPSS和FEMTO数据集上的综合实验表明,与基于GAN的方法相比,所提出的Diff-MTS在多样性、保真度和实用性方面表现显著更优。这些结果表明,Diff-MTS促进了工业数据的生成,有助于智能维护和工业大模型的构建。

英文摘要:

Industrial Multivariate Time Series (MTS) is a critical view of the industrial field for people to understand the state of machines. However, due to data collection difficulty and privacy concerns, available data for building industrial intelligence and industrial large models is far from sufficient. Therefore, industrial time series data generation is of great importance. Existing research usually applies Generative Adversarial Networks (GANs) to generate MTS. However, GANs suffer from unstable training process due to the joint training of the generator and discriminator. This paper proposes a temporal-augmented conditional adaptive diffusion model, termed Diff-MTS, for MTS generation. It aims to better handle the complex temporal dependencies and dynamics of MTS data. Specifically, a conditional Adaptive Maximum-Mean Discrepancy (Ada-MMD) method has been proposed for the controlled generation of MTS, which does not require a classifier to control the generation. It improves the condition consistency of the diffusion model. Moreover, a Temporal Decomposition Reconstruction UNet (TDR-UNet) is established to capture complex temporal patterns and further improve the quality of the synthetic time series. Comprehensive experiments on the C-MAPSS and FEMTO datasets demonstrate that the proposed Diff-MTS performs substantially better in terms of diversity, fidelity, and utility compared with GAN-based methods. These results show that Diff-MTS facilitates the generation of industrial data, contributing to intelligent maintenance and the construction of industrial large models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑