We consider change-point tests based on rank statistics to test for structural changes in long-range dependent observations. Under the hypothesis of stationary time series and under the assumption of a change with decreasing change-point height, the asymptotic distributions of corresponding test statistics are derived. For this, a uniform reduction principle for the sequential empirical process in a two-parameter Skorohod space equipped with a weighted supremum norm is proved. Moreover, we compare the efficiency of rank tests resulting from the consideration of different score functions. Under Gaussianity, the asymptotic relative efficiency of rank-based tests with respect to the CuSum test is 1, irrespective of the score function. Regarding the practical implementation of rank-based change-point tests, we suggest to combine self-normalized rank statistics with subsampling. The theoretical results are accompanied by simulation studies that, in particular, allow for a comparison of rank tests resulting from different score functions. With respect to the finite sample performance of rank-based change-point tests, the Van der Waerden rank test proves to be favorable in a broad range of situations. Finally, we analyze data sets from economy, hydrology, and network traffic monitoring in view of structural changes and compare our results to previous analysis of the data.
An autoregressive-moving average model in which all roots of the autoregressive polynomial are reciprocals of roots of the moving average polynomial and vice versa is called an all-pass time series model. All-pass models are useful for identifying and modeling noncausal and noninvertible autoregressive-moving average processes. We establish asymptotic normality and consistency for rank-based estimators of all-pass model parameters. The estimators are obtained by minimizing the rank-based residual dispersion function given by Jaeckel [Ann. Math. Statist. 43 (1972) 1449--1458]. These estimators …
This paper provides extensions of the work on subsampling by Bertail et al. (2004) for strongly mixing case to weakly dependent case by application of the results of Doukhan and Louhichi (1999). We investigate properties of smooth and rough subsampling estimators for distributions of converging and extreme statistics when the underlying time series is η or λ-weakly dependent.
The aim of this paper is to give a simpler, more usable sufficient condition to the regularity of generic weakly stationary time series. Also, this condition is used to show how regular processes satisfying these sufficient conditions can be approximated by a lower rank \emph{regular} process. The relevance of these issues is shown by the ever increasing presence of high-dimensional data in many fields lately, and because of this, low rank processes and low rank approximations are becoming more important. Moreover, regular processes are the ones which are completely influenced by random innova…
Tensor time series data appears naturally in a lot of fields, including finance and economics. As a major dimension reduction tool, similar to its factor model counterpart, the idiosyncratic components of a tensor time series factor model can exhibit serial correlations, especially in financial and economic applications. This rules out a lot of state-of-the-art methods that assume white idiosyncratic components, or even independent/Gaussian data. While the traditional higher order orthogonal iteration (HOOI) is proved to be convergent to a set of factor loading matrices, the closeness of them …
We introduce supervised feature ranking and feature subset selection algorithms for multivariate time series (MTS) classification. Unlike most existing supervised/unsupervised feature selection algorithms for MTS our techniques do not require a feature extraction step to generate a one-dimensional feature vector from the time series. Instead it is based on directly computing similarity between individual time series and assessing how well the resulting cluster structure matches the labels. The techniques are amenable to heterogeneous MTS data, where the time series measurements may have differ…
The problem of time series approximation by series of finite rank is considered from the viewpoint of signal extraction. For signal estimation, a weighted least-squares method is applied to the trajectory matrix of the considered time series. Matrix weights are chosen to obtain equal or approximately equal weights in the equivalent problem of time-series least-squares approximation. Several new methods are suggested and examined together with the Cadzow's iterative method. The questions of convergence, computational complexity, and accuracy are considered for the proposed methods. The methods …
The Hurst exponent is the simplest numerical summary of self-similar long-range dependent stochastic processes. We consider the estimation of Hurst exponent in long-range dependent curve time series. Our estimation method begins by constructing an estimate of the long-run covariance function, which we use, via dynamic functional principal component analysis, in estimating the orthonormal functions spanning the dominant sub-space of functional time series. Within the context of functional autoregressive fractionally integrated moving average models, we compare finite-sample bias, variance and m…
In this paper we offer a review and bibliography of work on Hankel low-rank approximation and completion, with particular emphasis on how this methodology can be used for time series analysis and forecasting. We begin by describing possible formulations of the problem and offer commentary on related topics and challenges in obtaining globally optimal solutions. Key theorems are provided, and the paper closes with some expository examples.
Carnegie Mellon University(卡内基梅隆大学);RIKEN Center for Artificial Intelligence Project(理化学研究所人工智能项目中心)
There has been an increased interest in multimodal language processing including multimodal dialog, question answering, sentiment analysis, and speech recognition. However, naturally occurring multimodal data is often imperfect as a result of imperfect modalities, missing entries or noise corruption. To address these concerns, we present a regularization method based on tensor rank minimization. Our method is based on the observation that high-dimensional multimodal time series data often exhibit correlations across time and modalities which leads to low-rank tensor representations. However, t…
Time series prediction has been a long-standing research topic and an essential application in many domains. Modern time series collected from sensor networks (e.g., energy consumption and traffic flow) are often large-scale and incomplete with considerable corruption and missing values, making it difficult to perform accurate predictions. In this paper, we propose a low-rank autoregressive tensor completion (LATC) framework to model multivariate time series data. The key of LATC is to transform the original multivariate time series matrix (e.g., sensor$\times$time point) to a third-order tens…
Low Rank Transformer for Multivariate Time Series Anomaly Detection and Localization
KIOS Research and Innovation Center of Excellence(KIOS研究与创新中心卓越研究所);Department of Electrical and Computer Engineering, University of Cyprus(电子与计算机工程系,塞浦路斯大学);Department of Mathematics and Statistics, University of Cyprus(数学与统计学系,塞浦路斯大学)
Ranked differences Pearson correlation dissimilarity with an application to electricity users time series clustering
Statistics, Probability, and Data Science with R programming (SPDR) research group(统计、概率与数据科学(SPDR)研究组);Department of Mathematics, King Mongkut’s University of Technology Thonburi(泰国科技理工大学数学系)
A powerful study design in the fields of genomics and metabolomics is the 'replicated time course experiment' where individual time series are observed for a sample of biological units, such as human patients, termed replicates. Standard practice for analysing these data sets is to fit each variable (e.g. gene transcript) independently with a functional mixed-effects model to account for between-replicate variance. However, such an independence assumption is biologically implausible given that the variables are known to be highly correlated. In this article we present a skew-t-normal multi-lev…
Predicting the dependencies between observations from multiple time series is critical for applications such as anomaly detection, financial risk management, causal analysis, or demand forecasting. However, the computational and numerical difficulties of estimating time-varying and high-dimensional covariance matrices often limits existing methods to handling at most a few hundred dimensions or requires making strong assumptions on the dependence between series. We propose to combine an RNN-based time series model with a Gaussian copula process output model with a low-rank covariance structure…
For the evaluation of information flow in bivariate time series, information measures have been employed, such as the transfer entropy (TE), the symbolic transfer entropy (STE), defined similarly to TE but on the ranks of the components of the reconstructed vectors, and the transfer entropy on rank vectors (TERV), similar to STE but forming the ranks for the future samples of the response system with regard to the current reconstructed vector. Here we extend TERV for multivariate time series, and account for the presence of confounding variables, called partial transfer entropy on ranks (PTERV…
This work considers stochastic comparisons of lifetimes of series and parallel systems with dependent and heterogeneous components having lifetimes following the proportional odds (PO) model. The joint distribution of component lifetimes is modeled by Archimedean survival copula. We discuss some potential applications of our findings in system reliability and actuarial science.
Paderborn University(帕德博恩大学);University of Oviedo(奥维耶多大学)
We consider the problem of statistical inference for ranking data, specifically rank aggregation, under the assumption that samples are incomplete in the sense of not comprising all choice alternatives. In contrast to most existing methods, we explicitly model the process of turning a full ranking into an incomplete one, which we call the coarsening process. To this end, we propose the concept of rank-dependent coarsening, which assumes that incomplete rankings are produced by projecting a full ranking to a random subset of ranks. For a concrete instantiation of our model, in which full rankin…