This paper addresses the problem of fitting a known distribution to the innovation distribution in a class of stationary and ergodic time series models. The asymptotic null distribution of the usual Kolmogorov--Smirnov test based on the residuals generally depends on the underlying model parameters and the error distribution. To overcome the dependence on the underlying model parameters, we propose that tests be based on a vector of certain weighted residual empirical processes. Under the null hypothesis and under minimal moment conditions, this vector of processes is shown to converge weakly to a vector of independent copies of a Gaussian process whose covariance function depends only on the fitted distribution and not on the model. Under certain local alternatives, the proposed test is shown to have nontrivial asymptotic power. The Monte Carlo critical values of this test are tabulated when fitting standard normal and double exponential distributions. The results obtained are shown to be applicable to GARCH and ARMA--GARCH models, the often used models in econometrics and finance. A simulation study shows that the test has satisfactory size and power for finite samples at these models. The paper also contains an asymptotic uniform expansion result for a general weighted residual empirical process useful in heteroscedastic models under minimal moment conditions, a result of independent interest.
Parameter estimation in a class of heteroscedastic time series models is investigated. The existence of conditional least-squares and conditional likelihood estimators is proved. Their consistency and their asymptotic normality are established. Kernel estimators of the noise's density and its derivatives are defined and shown to be uniformly consistent. A simulation experiment conducted shows that the estimators perform well for large sample size.
We propose a new asymptotic test to assess the stationarity of a time series' mean that is applicable in the presence of both heteroscedasticity and short-range dependence. Our test statistic is composed of Gini's mean difference of local sample means. To analyse its asymptotic behaviour, we develop new limit theory for U-statistics of strongly mixing triangular arrays under non-stationarity. Most importantly, we show asymptotic normality of the test statistic under the hypothesis of a constant mean and prove the test's consistency against a very general class of alternatives, including both s…
Einmahl, de Haan and Zhou (2016, Journal of the Royal Statistical Society: Series B, 78(1), 31-51) recently introduced a stochastic model that allows for heteroscedasticity of extremes. The model is extended to the situation where the observations are serially dependent, which is crucial for many practical applications. We prove a local limit theorem for a kernel estimator for the scedasis function, and a functional limit theorem for an estimator for the integrated scedasis function. We further prove consistency of a bootstrap scheme that allows to test for the null hypothesis that the extreme…
Traditional white noise testing, for example the Ljung-Box test, studies only the autocorrelation function (ACF). Time series can be heteroscedastic and therefore not i.i.d. but still white noise (that is, with zero ACF). An example of heteroscedasticity is financial time series: times of high variance (financial crises) can alternate with times of low variance (calm times). Here, absolute values of time series terms are not white noise. We could test for white noise separately for original and absolute values, for example using Ljung-Box tests for both. In this article, we create an omnibus t…
In order to calculate the unobserved volatility in conditional heteroscedastic time series models, the natural recursive approximation is very often used. Following \cite{StraumannMikosch2006}, we will call the model \emph{invertible} if this approximation (based on true parameter vector) converges to the real volatility. Our main results are necessary and sufficient conditions for invertibility. We will show that the stationary GARCH($p$, $q$) model is always invertible, but certain types of models, such as EGARCH of \cite{Nelson1991} and VGARCH of \cite{EngleNg1993} may indeed be non-inverti…
In the independent component model, the multivariate data is assumed to be a mixture of mutually independent latent components, and in independent component analysis (ICA) the aim is to estimate these latent components. In this paper we study an ICA method which combines the use of linear and quadratic autocorrelations in order to enable efficient estimation of various kinds of stationary time series. Statistical properties of the estimator are studied by finding its limiting distribution under general conditions, and the asymptotic variances are derived in the case of ARMA-GARCH model. We use…
In this paper we consider a regression model that allows for time series covariates as well as heteroscedasticity with a regression function that is modelled nonparametrically. We assume that the regression function changes at some unknown time $\lfloor ns_0\rfloor$, $s_0\in(0,1)$, and our aim is to estimate the (rescaled) change point $s_0$. The considered estimator is based on a Kolmogorov-Smirnov functional of the marked empirical process of residuals. We show consistency of the estimator and prove a rate of convergence of $O_P(n^{-1})$ which in this case is clearly optimal as there are onl…
Nonparametric and adaptive modeling of dynamic seasonality and trend with heteroscedastic and dependent errors
National Yang-Ming University Hospital（阳明大学医院）；Institute of Hospital and Health Care Administration, National Yang-Ming University（阳明大学医院与卫生管理研究所）；Department of Mathematics, National Taiwan University（台湾大学数学系）；Department of Statistics, University of California, Berkeley（加州大学伯克利分校统计系）
In this paper the testing of normality for unconditionally heteroscedastic macroeconomic time series is studied. It is underlined that the classical Jarque-Bera test (JB hereafter) for normality is inadequate in our framework. On the other hand it is found that the approach which consists in correcting the heteroscedasticity by kernel smoothing for testing normality is justified asymptotically. Nevertheless it appears from Monte Carlo experiments that such methodology can noticeably suffer from size distortion for samples that are typical for macroeconomic variables. As a consequence a paramet…
This paper offers a new method for estimation and forecasting of the volatility of financial time series when the stationarity assumption is violated. Our general local parametric approach particularly applies to general varying-coefficient parametric models, such as GARCH, whose coefficients may arbitrarily vary with time. Global parametric, smooth transition, and change-point models are special cases. The method is based on an adaptive pointwise selection of the largest interval of homogeneity with a given right-end point by a local change-point analysis. We construct locally adaptive estima…
In this paper, we introduce a new jump process modeling which involves a particular kind of non-Gaussian stochastic processes with random jumps at random time points. The main goal of this study is to provide an accurate tracking technique based on non-linear non-stationary heteroscedasticity (NNH) time series. It is, in fact, difficult to track jump processes regarding the fact that non-Gaussianity is an inherent feature in these processes. The proposed NNH model is conditionally Gaussian whose conditional variance is time-varying. Therefore, we use Kalman filter for state tracking. We show a…
Many financial time series have varying structures at different quantile levels, and also exhibit the phenomenon of conditional heteroscedasticity at the same time. In the meanwhile, it is still lack of a time series model to accommodate both of the above features simultaneously. This paper fills the gap by proposing a novel conditional heteroscedastic model, which is called the quantile double autoregression. The strict stationarity of the new model is derived, and a self-weighted conditional quantile estimation is suggested. Two promising properties of the original double autoregressive mode…
Many wind speed forecasting approaches have been proposed in literature. In this paper a new statistical approach for jointly predicting wind speed, wind direction and air pressure is introduced. The wind direction and the air pressure are important to extend the forecasting accuracy of wind speed forecasts. A good forecast for the wind direction helps to bring the turbine into the predominant wind direction. We combine a multivariate seasonal time varying threshold autoregressive model with interactions (TVARX) with a threshold seasonal autoregressive conditional heteroscedastic (TARCHX) mode…
Testing for white noise has been well studied in the literature of econometrics and statistics. For most of the proposed test statistics, such as the well-known Box-Pierce's test statistic with fixed lag truncation number, the asymptotic null distributions are obtained under independent and identically distributed assumptions and may not be valid for the dependent white noise. Due to recent popularity of conditional heteroscedastic models (e.g., GARCH models), which imply nonlinear dependence with zero autocorrelation, there is a need to understand the asymptotic properties of the existing tes…
This paper studies the quasi-maximum-likelihood estimator (QMLE) in a general conditionally heteroscedastic time series model of multiplicative form $X_t=σ_tZ_t$, where the unobservable volatility $σ_t$ is a parametric function of $(X_{t-1},...,X_{t-p},σ_{t-1},... ,σ_{t-q})$ for some $p,q\ge0$, and $(Z_t)$ is standardized i.i.d. noise. We assume that these models are solutions to stochastic recurrence equations which satisfy a contraction (random Lipschitz coefficient) property. These assumptions are satisfied for the popular GARCH, asymmetric GARCH and exponential GARCH processes. Exploiting …
Detecting abrupt changes in the mean of a time series, so-called changepoints, is important for many applications. However, many procedures rely on the estimation of nuisance parameters (like long-run variance). Under the alternative (a change in mean), estimators might be biased and data-adaptive rules for the choice of tuning parameters might not work as expected. If the data is not stationary, but heteroscedastic, this becomes more challenging. The aim of this paper is to present and investigate two changepoint tests, which involve neither nuisance nor tuning parameters. This is achieved by…
Many time series exhibit changes both in level and in variability. Generally, it is more important to detect a change in the level, and changing or smoothly evolving variability can confound existing tests. This paper develops a framework for testing for shifts in the level of a series which accommodates the possibility of changing variability. The resulting tests are robust both to heteroskedasticity and serial dependence. They rely on a new functional central limit theorem for dependent random variables whose variance can change or trend in a substantial way. This new result is of independen…
Heteroscedasticity is common in real world applications and is often handled by incorporating case weights into a modeling procedure. Intuitively, models fitted with different weight schemes would have a different level of complexity depending on how well the weights match the inverse of error variances. However, existing statistical theories on model complexity, also known as model degrees of freedom, were primarily established under the assumption of equal error variances. In this work, we focus on linear regression procedures and seek to extend the existing measures to a heteroscedastic set…
We consider a nonparametric heteroscedastic time series regression model and suggest testing procedures to detect changes in the conditional variance function. The tests are based on a sequential marked empirical process and thus combine classical CUSUM tests with marked empirical process approaches known from goodness-of-fit testing. The tests are consistent against general alternatives of a change in the conditional variance function, a feature that classical CUSUM tests are lacking. We derive a simple limiting distribution and in the case of univariate covariates even obtain asymptotically …
Estimating value-at-risk on time series data with possibly heteroscedastic dynamics is a highly challenging task. Typically, we face a small data problem in combination with a high degree of non-linearity, causing difficulties for both classical and machine-learning estimation algorithms. In this paper, we propose a novel value-at-risk estimator using a long short-term memory (LSTM) neural network and compare its performance to benchmark GARCH estimators. Our results indicate that even for a relatively short time series, the LSTM could be used to refine or monitor risk estimation processes and…
The decomposition of a time series is an essential task that helps to understand its very nature. It facilitates the analysis and forecasting of complex time series expressing various hidden components such as the trend, seasonal components, cyclic components and irregular fluctuations. Therefore, it is crucial in many fields for forecasting and decision processes. In recent years, many methods of time series decomposition have been developed, which extract and reveal different time series properties. Unfortunately, they neglect a very important property, i.e. time series variance. To deal wit…
Using cumulative residual processes, we propose joint goodness-of-fit tests for conditional means and variances functions in the context of nonlinear time series with martingale difference innovations. The main challenge comes from the fact the cumulative residual process no longer admits, under the null hypothesis, a distribution-free limit. To obtain a practical solution one either transforms the process in order to achieve a distribution-free limit or approximates the non-distribution free limit using a numerical or a re-sampling technique. Here the three solutions will be considered.It is …
The goodness of the long-term prediction in the state-space model was evaluated using the squared long-term prediction error. In order to estimate the model parameters suitable for long-term prediction, we devised a modified log-likelihood corresponding to the long-term prediction error variance. Trend models and seasonally adjusted models with and without AR component are examined as examples.
The discrete-time GARCH methodology which has had such a profound influence on the modelling of heteroscedasticity in time series is intuitively well motivated in capturing many `stylized facts' concerning financial series, and is now almost routinely used in a wide range of situations, often including some where the data are not observed at equally spaced intervals of time. However, such data is more appropriately analyzed with a continuous-time model which preserves the essential features of the successful GARCH paradigm. One possible such extension is the diffusion limit of Nelson, but this…
Functional time series have become an integral part of both functional data and time series analysis. Important contributions to methodology, theory and application for the prediction of future trajectories and the estimation of functional time series parameters have been made in the recent past. This paper continues this line of research by proposing a first principled approach to estimate invertible functional time series by fitting functional moving average processes. The idea is to estimate the coefficient operators in a functional linear filter. To do this a functional Innovations Algorit…
Graphical interaction models have become an important tool for analysing multivariate time series. In these models, the interrelationships among the components of a time series are described by undirected graphs in which the vertices depict the components while the edges indictate possible dependencies between the components. Current methods for the identification of the graphical structure are based on nonparametric spectral stimation, which prevents application of common model selection strategies. In this paper, we present a parametric approach for graphical interaction modelling of multiva…
In time-series analyses, particularly for finance, generalized autoregressive conditional heteroscedasticity (GARCH) models are widely applied statistical tools for modelling volatility clusters (i.e., periods of increased or decreased risk). In contrast, it has not been considered to be of critical importance until now to model spatial dependence in the conditional second moments. Only a few models have been proposed for modelling local clusters of increased risks. In this paper, we introduce novel spatial GARCH and exponential GARCH processes in a unified spatial and spatiotemporal GARCH-typ…
We develop an estimator for the high-dimensional covariance matrix of a locally stationary process with a smoothly varying trend and use this statistic to derive consistent predictors in non-stationary time series. In contrast to the currently available methods for this problem the predictor developed here does not rely on fitting an autoregressive model and does not require a vanishing trend. The finite sample properties of the new methodology are illustrated by means of a simulation study and a financial indices study.
This paper presents a data-based simple model for fitting the available data of the Covid-19 pandemic evolution in France. The time series concerning the 13 regions of mainland France have been considered for fitting and validating the model. An extremely simple, two-dimensional model with only two parameters demonstrated to be able to reproduce the time series concerning the number of daily demises caused by Covid-19, the hospitalizations, intensive care and emergency accesses, the daily number of positive test and other indicators, for the different French regions. These results might contri…
While the {estimation} of risk is an important question in the daily business of banking and insurance, many existing plug-in estimation procedures suffer from an unnecessary bias. This often leads to the underestimation of risk and negatively impacts backtesting results, especially in small sample cases. In this article we show that the link between estimation bias and backtesting can be traced back to the dual relationship between risk measures and the corresponding performance measures, and discuss this in reference to value-at-risk, expected shortfall and expectile value-at-risk. Motivated…
The Model-free Prediction Principle of Politis (2015) has been successfully applied to general regression problems, as well as problems involving stationary time series. However, with long time series, e.g. annual temperature measurements spanning over 100 years or daily financial returns spanning several years, it may be unrealistic to assume stationarity throughout the span of the dataset. In the paper at hand, we show how Model-free Prediction can be applied to handle time series that are only locally stationary, i.e., they can be assumed to be as stationary only over short time-windows. Su…
The predictability of a time series is determined by the sensitivity to initial conditions of its data generating process. In this paper our goal is to characterize this sensitivity from a finite sample by assuming few hypotheses on the data generating model structure. In order to measure the distance between two trajectories induced by a same noisy chaotic dynamic from two close initial conditions, a symmetric Kullback-Leiber divergence measure is used. Our approach allows to take into account the dependence of the residual variance on initial conditions. We show it is linked to a Fisher info…
School of Information and Physical Sciences, University of Newcastle（纽卡斯尔大学信息与物理科学学院）；International Computer Science Institute（国际计算机科学研究所）；Department of Management Science and Engineering, Stanford University（斯坦福大学管理科学与工程系）
In time series analysis, when fitting an autoregressive model, one must solve a Toeplitz ordinary least squares problem numerous times to find an appropriate model, which can severely affect computational times with large data sets. Two recent algorithms (LSAR and Repeated Halving) have applied randomized numerical linear algebra (RandNLA) techniques to fitting an autoregressive model to big time-series data. We investigate and compare the quality of these two approximation algorithms on large-scale synthetic and real-world data. While both algorithms display comparable results for synthetic d…
High-dimensional time series data appear in many scientific areas in the current data-rich environment. Analysis of such data poses new challenges to data analysts because of not only the complicated dynamic dependence between the series, but also the existence of aberrant observations, such as missing values, contaminated observations, and heavy-tailed distributions. For high-dimensional vector autoregressive (VAR) models, we introduce a unified estimation procedure that is robust to model misspecification, heavy-tailed noise contamination, and conditional heteroscedasticity. The proposed met…
Most mechanistic predator-prey modelling has involved either parameterization from process rate data or inverse modelling. Here, we take a median road: we aim at identifying the potential benefits of combining datasets, when both population growth and predation processes are viewed as stochastic. We fit a discrete-time, stochastic predator-prey model of the Leslie type to simulated time series of densities and kill rate data. Our model has both environmental stochasticity in the growth rates and interaction stochasticity, i.e., a stochastic functional response. We examine what the kill rate da…
In this paper an autoregressive time series model with conditional heteroscedasticity is considered, where both conditional mean and conditional variance function are modeled nonparametrically. A test for the model assumption of independence of innovations from past time series values is suggested. The test is based on an weighted $L^2$-distance of empirical characteristic functions. The asymptotic distribution under the null hypothesis of independence is derived and consistency against fixed alternatives is shown. A smooth autoregressive residual bootstrap procedure is suggested and its perfo…
