arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2411.04554cs.LG
收藏

Peri-midFormer:用于时间序列分析的周期金字塔Transformer

Peri-midFormer: Periodic Pyramid Transformer for Time Series Analysis

School of Artificial Intelligence, Xidian University(西安电子科技大学人工智能学院);Xidian University(西安电子科技大学)

Qiang Wu, Gechang Yao, Zhixi Feng, Shuyuan Yang

AI总结:

针对时间序列分析中多周期变化建模难题,提出周期金字塔Transformer,通过解耦周期分量并引入自注意力,在五个主流任务上取得卓越性能。

摘要:

时间序列分析在天气预报、异常检测和行为识别等领域有着广泛的应用。以往的方法试图直接使用一维时间序列对时间变化进行建模。然而,由于时间序列中数据点的离散性以及周期变化的复杂性,这相当具有挑战性。在周期性方面,以天气和交通数据为例,存在年、月、周、日等多周期变化。为了突破以往方法的局限性,我们基于对其中多周期性的观察及其包含关系,将隐含的复杂周期变化解耦为不同层级周期分量之间的包含和重叠关系。这显式地表示了时间序列中自然存在的金字塔状特性,其中顶层是原始时间序列,较低层级由周期逐渐缩短的周期分量组成,我们称之为周期金字塔。为了进一步提取复杂的时间变化,我们将自注意力机制引入周期金字塔,通过基于周期分量之间的包含、重叠和邻接关系计算注意力来捕获复杂的周期关系。我们提出的Peri-midFormer在五个主流时间序列分析任务中表现出卓越的性能,包括短期和长期预测、插补、分类和异常检测。

英文摘要:

Time series analysis finds wide applications in fields such as weather forecasting, anomaly detection, and behavior recognition. Previous methods attempted to model temporal variations directly using 1D time series. However, this has been quite challenging due to the discrete nature of data points in time series and the complexity of periodic variation. In terms of periodicity, taking weather and traffic data as an example, there are multi-periodic variations such as yearly, monthly, weekly, and daily, etc. In order to break through the limitations of the previous methods, we decouple the implied complex periodic variations into inclusion and overlap relationships among different level periodic components based on the observation of the multi-periodicity therein and its inclusion relationships. This explicitly represents the naturally occurring pyramid-like properties in time series, where the top level is the original time series and lower levels consist of periodic components with gradually shorter periods, which we call the periodic pyramid. To further extract complex temporal variations, we introduce self-attention mechanism into the periodic pyramid, capturing complex periodic relationships by computing attention between periodic components based on their inclusion, overlap, and adjacency relationships. Our proposed Peri-midFormer demonstrates outstanding performance in five mainstream time series analysis tasks, including short- and long-term forecasting, imputation, classification, and anomaly detection.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑