The family of semi-stable laws is shown to be semi-selfdecomposable. Thus they qualify to model stationary first order autoregressive schemes. A connection between these autoregressive schemes with semi-stable marginals and semi-selfsimilar processes is given.
A semi-analytic method is proposed for the generation of realizations of a multivariate process of a given linear correlation structure and marginal distribution. This is an extension of a similar method for univariate processes, transforming the autocorrelation of the non-Gaussian process to that of a Gaussian process based on a piece-wise linear marginal transform from non-Gaussian to Gaussian marginal. The extension to multivariate processes involves the derivation of the autocorrelation matrix from the marginal transforms, which determines the generating vector autoregressive process. The …
INteger Auto-Regressive (INAR) processes are usually defined by specifying the innovations and the operator, which often leads to difficulties in deriving marginal properties of the process. In many practical situations, a major modeling limitation is that it is difficult to justify the choice of the operator. To overcome these drawbacks, we propose a new flexible approach to build an INAR model: we pre-specify the marginal and innovation distributions. Hence, the operator is a consequence of specifying the desired marginal and innovation distributions. Our new INAR model has both marginal and…
Learning vector autoregressive models from multivariate time series is conventionally approached through least squares or maximum likelihood estimation. These methods typically assume a fully connected model which provides no direct insight to the model structure and may lead to highly noisy estimates of the parameters. Because of these limitations, there has been an increasing interest towards methods that produce sparse estimates through penalized regression. However, such methods are computationally intensive and may become prohibitively time-consuming when the number of variables in the mo…
In this article, we introduce and study a one sided tempered stable first order autoregressive model called TAR(1). Under the assumption of stationarity of the model, the marginal probability density function of the error term is found. It is shown that the distribution of the error term is infinitely divisible. Parameter estimation of the introduced TAR(1) process is done by adopting the conditional least square and method of moments based approach and the performance of the proposed methods are evaluated on simulated data. Also we study an autoregressive model of order one with tempered stab…
In this paper, we consider the problem of estimating the marginal density in some nonlinear autoregressive time series models for which the conditional mean and variance have a parametric specification. Under some regularity conditions, we show that a kernel type estimate based on the residuals can be root-n consistent even if the noise density is unknown. Our results, which are shown to be valid for classical time series models such as ARMA or GARCH processes, extend substantially the existing results obtained for some homoscedatic time series models. Asymptotic expansion of our estimator is …
The recently proposed mask-predict decoding algorithm has narrowed the performance gap between semi-autoregressive machine translation models and the traditional left-to-right approach. We introduce a new training method for conditional masked language models, SMART, which mimics the semi-autoregressive behavior of mask-predict, producing training examples that contain model predictions as part of their inputs. Models trained with SMART produce higher-quality translations when using mask-predict decoding, effectively closing the remaining performance gap with fully autoregressive models.
Here we develop a first order autoregressive model {Xn} that is marginally stationary where Xn is the sum/ extreme of k i.i.d observations. We prove that stationary solutions to these models are either semi-selfdecomposable/ extreme-semi-selfdecomposable or, sum/ extreme stable with respect to Harris distribution.
The tail index, indicating the degree of fatness of the tail distribution, is an important component of extreme value theory since it dominates the asymptotic distribution of extreme values such as the sample maximum. In this paper, we consider the problem of testing for a change in the tail index of time series data. As a test, we employ the cusum test and investigate its null limiting distribution. Further, we derive the null limiting distribution of the cusum test based on the residuals from autoregressive models. Simulation results are provided for illustration.
A time series is a sequence of observations taken sequentially in time. The autoregressive integrated moving average is a class of the model more used for times series data. However, this class of model has two critical limitations. It fits well onlyGaussian data with the linear structure of correlation. Here, I present a new model named as generalized autoregressive neural networks, GARNN. The GARNN is an extension of the generalized linear model where the mean marginal depends on the lagged values via the inclusion of the neural network in the link function. A practical application of the mo…
Methods of construction of Max-semi-selfdecompsable laws are given. Implications of this method in random time changed extremal processes are discussed. Max-autoregressive model is introduced and characterized using the max-semi-selfdecompsable laws and exponential max-semi-stable laws. Max-semi-selfddecomposability of max-semi-stable laws are proved.
A regularized vector autoregressive hidden semi-Markov model is developed to analyze multivariate financial time series with switching data generating regimes. Furthermore, an augmented EM algorithm is proposed for parameter estimation by embedding regularized estimators for the state-dependent covariance matrices and autoregression matrices in the M-step. The performance of the proposed regularized estimators is evaluated both in the simulation experiments and on the New York Stock Exchange financial portfolio data.
Most of the stationary first-order autoregressive integer-valued (INAR(1)) models were developed for a given thinning operator using either the forward approach or the backward approach. In the forward approach the marginal distribution of the time series is specified and an appropriate distribution for the innovation sequence is sought. Whereas in the backward setting, the roles are reversed. The common distribution of the innovation sequence is specified and the distributional properties of the marginal distribution of the time series are studied. In this article we focus on the backward app…
We discuss semi-selfdecomposable laws in the minimum scheme and characterize them using an autoregressive model. Semi-Pareto and semi-Weibull laws of Pillai (1991) are shown to be semi-selfdecomposable in this scheme. Methods for deriving this class of laws are then attempted from the angle of randomization. Finally, discrete analogues of these results are also considered.
The structure of stationary first order max-autoregressive schemes with max-semi-stable marginals is studied. A connection between semi-selfsimilar extremal processes and this max-autoregressive scheme is discussed resulting in their characterizations. Corresponding cases of max-stable and selfsimilar extremal processes are also discussed.
In this work we consider the problem of anomaly detection in heterogeneous, multivariate, variable-length time series datasets. Our focus is on the aviation safety domain, where data objects are flights and time series are sensor readings and pilot switches. In this context the goal is to detect anomalous flight segments, due to mechanical, environmental, or human factors in order to identifying operationally significant events and provide insights into the flight operations and highlight otherwise unavailable potential safety risks and precursors to accidents. For this purpose, we propose a f…
Latent Block-Diffusion Temporal Point Processes: A Semi-Autoregressive Framework for Asynchronous Event Sequence Generation
Academy of Mathematics and Systems Science, Chinese Academy of Sciences(中国科学院数学与系统科学研究院);Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);Department of Data Science, City University of Hong Kong(香港城市大学数据科学系);Department of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术系)
We investigate in this paper a Bickel-Rosenblatt test of goodness-of-fit for the density of the noise in an autoregressive model. Since the seminal work of Bickel and Rosenblatt, it is well-known that the integrated squared error of the Parzen-Rosenblatt density estimator, once correctly renormalized, is asymptotically Gaussian for independent and identically distributed (i.i.d.) sequences. We show that the result still holds when the statistic is built from the residuals of general stable and explosive autoregressive processes. In the univariate unstable case, we prove that the result holds w…
The vector autoregressive (VAR) model has been widely used for modeling temporal dependence in a multivariate time series. For large (and even moderate) dimensions, the number of AR coefficients can be prohibitively large, resulting in noisy estimates, unstable predictions and difficult-to-interpret temporal dependence. To overcome such drawbacks, we propose a 2-stage approach for fitting sparse VAR (sVAR) models in which many of the AR coefficients are zero. The first stage selects non-zero AR coefficients based on an estimate of the partial spectral coherence (PSC) together with the use of B…
Efficient Autoregressive Inference for Transformer Probabilistic Models
Department of Computer Science, Aalto University, Finland(芬兰阿尔托大学计算机科学系);ELLIS Institute Finland(芬兰ELLIS研究所);Department of Computer Science, University of Helsinki, Finland(芬兰赫尔辛基大学计算机科学系);Verda;Department of Computer Science, University of Manchester, UK(英国曼彻斯特大学计算机科学系)
The autoregressive (AR) models are used to represent the time-varying random process in which output depends linearly on previous terms and a stochastic term (the innovation). In the classical version, the AR models are based on normal distribution. However, this distribution does not allow describing data with outliers and asymmetric behavior. In this paper, we study the AR models with normal inverse Gaussian (NIG) innovations. The NIG distribution belongs to the class of semi heavy-tailed distributions with wide range of shapes and thus allows for describing real-life data with possible jump…
We study four different approaches to model time-dependent extremal behavior: dynamics introduced by (a) a state-space model (SSM), (b) a shot-noise-type process with GPD marginals, (c) a copula-based autoregressive model with GPD marginals, and (d) a GLM with GPD marginals (and previous extremal events as regressors). Each of the models is fit against data, and from the fitted data, we simulate corresponding paths according to the respective fitted models. At this simulated data, the respective dependence structure is analyzed in copula plots and judged against its capacity to fit the corresp…
In this paper, we propose an unsupervised data-driven approach to predict real-time locational marginal prices (RTLMPs). The proposed approach is built upon a general data structure for organizing system-wide heterogeneous market data streams into the format of market data images and videos. Leveraging this general data structure, the system-wide RTLMP prediction problem is formulated as a video prediction problem. A video prediction model based on generative adversarial networks (GAN) is proposed to learn the spatio-temporal correlations among historical RTLMPs and predict system-wide RTLMPs …
We introduce and explore a new class of stationary time series models for variance matrices based on a constructive definition exploiting inverse Wishart distribution theory. The main class of models explored is a novel class of stationary, first-order autoregressive (AR) processes on the cone of positive semi-definite matrices. Aspects of the theory and structure of these new models for multivariate "volatility" processes are described in detail and exemplified. We then develop approaches to model fitting via Bayesian simulation-based computations, creating a custom filtering method that reli…
In this research, a functional time series model was introduced to predict future realizations of river flow time series. The proposed model was constructed based on a functional time series's correlated lags and the essential exogenous climate variables. Rainfall, temperature, and evaporation variables were hypothesized to have substantial functionality in river flow simulation. Because an actual time series model is unspecified and the input variables' significance for the learning process is unknown in practice, it was employed a variable selection procedure to determine only the significan…
We consider a family of multivariate autoregressive stochastic sequences that restart when hit a neighbourhood of the origin, and study their distributional limits when the autoregressive coefficient tends to one, the noise scaling parameter tends to zero, and the neighbourhood size varies. We obtain a non-standard limit theorem where the limiting distribution is a mixture of an atomic distribution and an absolutely continuous distribution whose marginals, in turn, are mixtures of distributions of signed absolute values of normal random variables. In particular, we provide conditions for the l…
In this note we correct an omission in our paper (Satheesh and Sandhya, 2005) in defining semi-selfdecomposable laws and also show with examples that the marginal distributions of a stationary AR(1) process need not even be infinitely divisible.
Extreme-value theory for random vectors and stochastic processes with continuous trajectories is usually formulated for random objects all of whose univariate marginal distributions are identical. In the spirit of Sklar's theorem from copula theory, such marginal standardization is carried out by the pointwise probability integral transform. Certain situations, however, call for stochastic models whose trajectories are not continuous but merely upper semicontinuous (usc). Unfortunately, the pointwise application of the probability integral transform to a usc process does in general not preserv…
It is shown that some convolution semigroups of infinitely divisible measures are invariant under the random integral mappings $I^{h,r}_{(a,b]}$ defined in $(\star)$ below. The converse implication is specified for the semigroups of generalized s-selfdecomposable and selfdecomposable distributions. Some application are given to the moving average fractional Lévy process (MAFLP).
We explore the robust replication of forward-start straddles given quoted (Call and Put options) market data. One approach to this problem classically follows semi-infinite linear programming arguments, and we propose a discretisation scheme to reduce its dimensionality and hence its complexity. Alternatively, one can consider the dual problem, consisting in finding optimal martingale measures under which the upper and the lower bounds are attained. Semi-analytical solutions to this dual problem were proposed by Hobson and Klimmek (2013) and by Hobson and Neuberger (2008). We recast this dual …