用于时间序列降维和在线异常检测的分布无关符号表示
Distribution Agnostic Symbolic Representations for Time Series Dimensionality Reduction and Online Anomaly Detection
AI总结:
本文提出两种数据驱动的SAX符号表示方法,分别通过核密度估计结合Lloyd-Max量化和Mean-Shift聚类,克服传统SAX的高斯分布和等概率符号假设限制,有效提升时间序列降维、索引及异常检测性能。
摘要:
由于下界距离的重要性以及符号表示的吸引力,符号聚合近似(SAX)家族已被广泛用于编码时间序列数据。然而,典型的基于SAX的方法依赖于两个限制性假设:高斯分布和等概率符号。本文提出了两种新颖的、数据驱动的基于SAX的符号表示,它们的区别在于离散化步骤。第一种表示面向一般的数据压缩和索引场景,基于核密度估计和Lloyd-Max量化的结合,以最小化离散化步骤中的信息损失和均方误差。第二种方法面向高层挖掘任务,采用Mean-Shift聚类方法,并表明能增强低维空间中的异常检测。此外,我们在理论上验证了先前观察到的一个关于内在过程的现象,该现象导致中间的分段聚合近似的方差低于预期。该现象会导致额外的信息损失,但可以通过简单的修改来避免。所提出的表示具有传统SAX方法的所有吸引人的特性。此外,在真实世界数据集上的实验评估表明,与传统的SAX和一种替代的数据驱动SAX变体相比,它们具有优越性。
英文摘要:
Due to the importance of the lower bounding distances and the attractiveness of symbolic representations, the family of symbolic aggregate approximations (SAX) has been used extensively for encoding time series data. However, typical SAX-based methods rely on two restrictive assumptions; the Gaussian distribution and equiprobable symbols. This paper proposes two novel data-driven SAX-based symbolic representations, distinguished by their discretization steps. The first representation, oriented for general data compaction and indexing scenarios, is based on the combination of kernel density estimation and Lloyd-Max quantization to minimize the information loss and mean squared error in the discretization step. The second method, oriented for high-level mining tasks, employs the Mean-Shift clustering method and is shown to enhance anomaly detection in the lower-dimensional space. Besides, we verify on a theoretical basis a previously observed phenomenon of the intrinsic process that results in a lower than the expected variance of the intermediate piecewise aggregate approximation. This phenomenon causes an additional information loss but can be avoided with a simple modification. The proposed representations possess all the attractive properties of the conventional SAX method. Furthermore, experimental evaluation on real-world datasets demonstrates their superiority compared to the traditional SAX and an alternative data-driven SAX variant.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。