arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2404.08175eess.SYcs.SY
收藏

一种以负荷图像为输入的基于视觉Transformer的新型负荷曲线分析方法

A Novel Vision Transformer based Load Profile Analysis using Load Images as Inputs

Hyeonjin Kim, Yi Hu, Kai Ye, Ning Lu

AI总结:

本研究提出ViT4LPA方法,将负荷曲线转为图像,用含百万级样本的数据集以自监督掩码图像建模预训练视觉Transformer,用于多种负荷分析下游任务,性能优于现有模型并揭示了注意力机制。

摘要:

本文提出了ViT4LPA,这是一种创新的基于视觉Transformer(ViT)的负荷曲线分析(LPA)方法。我们将时间序列负荷曲线转换为负荷图像,从而得以利用原本为图像处理设计的ViT架构作为预训练图像编码器,挖掘负荷数据中的潜在模式。ViT使用一个大规模负荷图像数据集进行预训练,该数据集包含从2000名居民用户两年间收集的智能电表数据生成的100万张负荷图像。训练采用自监督的掩码图像建模方法,即通过恢复被掩码的负荷图像来揭示图像块之间的隐藏关联。预训练后的ViT编码器随后被应用于多种下游任务,包括电动汽车(EV)充电负荷识别、表后太阳能光伏(PV)系统识别以及负荷分解。仿真结果表明,ViT4LPA在下游任务中的性能优于现有神经网络模型。此外,我们还对ViT4LPA模型中的注意力权重进行了深入分析,以探究其信息流机制。

英文摘要:

This paper introduces ViT4LPA, an innovative Vision Transformer (ViT) based approach for Load Profile Analysis (LPA). We transform time-series load profiles into load images. This allows us to leverage the ViT architecture, originally designed for image processing, as a pre-trained image encoder to uncover latent patterns within load data. ViT is pre-trained using an extensive load image dataset, comprising 1M load images derived from smart meter data collected over a two-year period from 2,000 residential users. The training methodology is self-supervised, masked image modeling, wherein masked load images are restored to reveal hidden relationships among image patches. The pre-trained ViT encoder is then applied to various downstream tasks, including the identification of electric vehicle (EV) charging loads and behind-the-meter solar photovoltaic (PV) systems and load disaggregation. Simulation results illustrate ViT4LPA's superior performance compared to existing neural network models in downstream tasks. Additionally, we conduct an in-depth analysis of the attention weights within the ViT4LPA model to gain insights into its information flow mechanisms.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑