For estimating the unknown parameters in an unstable autoregressive AR(p), the paper proposes sequential least squares estimates with a special stopping time defined by the trace of the observed Fisher information matrix. The limiting distribution of the sequential LSE is shown to be normal for the parameter vector lying both inside the stability region and on some part of its boundary in contrast to the ordinary LSE. The asymptotic normality of the sequential LSE is provided by a new property of the observed Fisher information matrix which holds both inside the stability region of AR(p) process and on the part of its boundary. The asymptotic distribution of the stopping time is derived.
We are interested in the implications of a linearly autocorrelated driven noise on the asymptotic behavior of the usual least squares estimator in a stable autoregressive process. We show that the least squares estimator is not consistent and we suggest a sharp analysis of its almost sure limiting value as well as its asymptotic normality. We also establish the almost sure convergence and the asymptotic normality of the estimated serial correlation parameter of the driven noise. Then, we derive a statistical procedure enabling to test for correlation of any order in the residuals of an autoreg…
Estimating the innovation probability density is an important issue in any regression analysis. This paper focuses on functional autoregressive models. A residual-based kernel estimator is proposed for the innovation density. Asymptotic properties of this estimator depend on the average prediction error of the functional autoregressive function. Sufficient conditions are studied to provide strong uniform consistency and asymptotic normality of the kernel density estimator.
The aim of this paper is to define a nonlinear least squares estimator for the spectral parameters of a spherical autoregressive process of order 1 in a parametric setting. Furthermore, we investigate on its asymptotic properties, such as weak consistency and asymptotic normality.
The purpose of this paper is to investigate the asymptotic behavior of the Durbin-Watson statistic for the stable $p-$order autoregressive process when the driven noise is given by a first-order autoregressive process. It is an extension of the previous work of Bercu and Proïa devoted to the particular case $p=1$. We establish the almost sure convergence and the asymptotic normality for both the least squares estimator of the unknown vector parameter of the autoregressive process as well as for the serial correlation estimator associated with the driven noise. In addition, the almost sure rate…
The first purpose of this article is to obtain a.s. asymptotic properties of the maximum likelihood estimator in the autoregressive process driven by a stationary Gaussian noise. The second purpose is to show the local asymptotic normality property of the likelihoods ratio in order to get a notion of asymptotic efficiency and to build an asymptotically uniformly invariant most powerful procedure for testing the significance of the autoregressive parameter.
In this paper we introduce a modified version of a gaussian standard first-order autoregressive process where we allow for a dependence structure between the state variable $Y_{t-1}$ and the next innovation $ξ_t$. We call this model dependent innovations gaussian AR(1) process (DIG-AR(1)). We analyze the moment and temporal dependence properties of the new model. After proving that the OLS estimator does not consistently estimate the autoregressive parameter, we introduce an infeasible estimator and we provide its $\sqrt{T}$-asymptotic normality.
The purpose of this paper is to provide a sharp analysis on the asymptotic behavior of the Durbin-Watson statistic. We focus our attention on the first-order autoregressive process where the driven noise is also given by a first-order autoregressive process. We establish the almost sure convergence and the asymptotic normality for both the least squares estimator of the unknown parameter of the autoregressive process as well as for the serial correlation estimator associated to the driven noise. In addition, the almost sure rates of convergence of our estimates are also provided. It allows us …
This paper presents a model of asymmetric bifurcating autoregressive process with random coefficients. We couple this model with a Galton Watson tree to take into account possibly missing observations. We propose least-squares estimators for the various parameters of the model and prove their consistency with a convergence rate, and their asymptotic normality. We use both the bifurcating Markov chain and martingale approaches and derive new important general results in both these frameworks.
In this work we deal with the problem of fitting an error density to the goodness-of-fit test of the errors in nonlinear autoregressive time series models with stationary $α$-mixing error terms. The test statistic is based on the integrated squared error of the nonparametric error density estimate and the null error density. By deriving the asymptotic normality of test statistics in these models, we extend the result of Cheng and Sun (Statist. Probab. Lett. \textbf{78}, 1(2008), 50-59) in the model with i.i.d error terms to the more general case.
An autoregressive process with Markov regime is an autoregressive process for which the regression function at each time point is given by a nonobservable Markov chain. In this paper we consider the asymptotic properties of the maximum likelihood estimator in a possibly nonstationary process of this kind for which the hidden state space is compact but not necessarily finite. Consistency and asymptotic normality are shown to follow from uniform exponential forgetting of the initial distribution for the hidden Markov chain conditional on the observations.
We discuss nonparametric estimation of the distribution function $G(x)$ of the autoregressive coefficient $a \in (-1,1)$ from a panel of $N$ random-coefficient AR(1) data, each of length $n$, by the empirical distribution function of lag 1 sample autocorrelations of individual AR(1) processes. Consistency and asymptotic normality of the empirical distribution function and a class of kernel density estimators is established under some regularity conditions on $G(x)$ as $N$ and $n$ increase to infinity. The Kolmogorov-Smirnov goodness-of-fit test for simple and composite hypotheses of Beta distr…
In this paper, we consider an inference problem for the first order autoregressive process with non-zero mean driven by a long memory stationary Gaussian process. Suppose that the covariance function of the noise can be expressed as $|k|^{2H-2}$ times a positive constant when $k$ tends to infinity, and the fractional Gaussian noise and the fractional ARIMA model are special examples that satisfy this assumption. We propose moment estimators and prove the strong consistency, the asymptotic normality and joint asymptotic normality.
A random coefficient autoregressive process is deeply investigated in which the coefficients are correlated. First we look at the existence of a strictly stationary causal solution, we give the second-order stationarity conditions and the autocorrelation function of the process. Then we study some asymptotic properties of the empirical mean and the usual estimators of the process, such as convergence, asymptotic normality and rates of convergence, supplied with the appropriate assumptions on the driving perturbations. Our objective is to get an overview of the influence of correlated coefficie…
We estimate the unknown parameters of an asymmetric bifurcating autoregressive process (BAR) when some of the data are missing. In this aim, we model the observed data by a two-type Galton-Watson process consistent with the binary tree structure of the data. Under independence between the process leading to the missing data and the BAR process and suitable assumptions on the driven noise, we establish the strong consistency of our estimators on the set of non-extinction of the Galton-Watson, via a martingale approach. We also prove a quadratic strong law and the asymptotic normality.
A wide literature is available on the asymptotic behavior of the Durbin-Watson statistic for autoregressive models. However, it is impossible to find results on the Durbin-Watson statistic for autoregressive models with adaptive control. Our purpose is to fill the gap by establishing the asymptotic behavior of the Durbin Watson statistic for ARX models in adaptive tracking. On the one hand, we show the almost sure convergence as well as the asymptotic normality of the least squares estimators of the unknown parameters of the ARX models. On the other hand, we establish the almost sure convergen…
In this paper we derive the asymptotic properties of the least squares estimator (LSE) of autoregressive moving-average (ARMA) models with regime changes under the assumption that the errors are uncorrelated but not necessarily independent. Relaxing the independence assumption considerably extends the range of application of the class of ARMA models with regime changes. Conditions are given for the consistency and asymptotic normality of the LSE. A particular attention is given to the estimation of the asymptotic covariance matrix, which may be very different from that obtained in the standard…
In this paper, we consider a model called CHARME (Conditional Heteroscedastic Autoregressive Mixture of Experts), a class of generalized mixture of nonlinear nonparametric AR-ARCH time series. Under certain Lipschitz-type conditions on the autoregressive and volatility functions, we prove that this model is stationary, ergodic and $τ$-weakly dependent. These conditions are much weaker than those presented in the literature that treats this model. Moreover, this result forms the theoretical basis for deriving an asymptotic theory of the underlying (non)parametric estimation, which we present fo…
In this work we introduce the class of beta autoregressive fractionally integrated moving average models for continuous random variables taking values in the continuous unit interval $(0,1)$. The proposed model accommodates a set of regressors and a long-range dependent time series structure. We derive the partial likelihood estimator for the parameters of the proposed model, obtain the associated score vector and Fisher information matrix. We also prove the consistency and asymptotic normality of the estimator under mild conditions. Hypotheses testing, diagnostic tools and forecasting are als…
This paper provides an entire inference procedure for the autoregressive model under (conditional) heteroscedasticity of unknown form with a finite variance. We first establish the asymptotic normality of the weighted least absolute deviations estimator (LADE) for the model. Second, we develop the random weighting (RW) method to estimate its asymptotic covariance matrix, leading to the implementation of the Wald test. Third, we construct a portmanteau test for model checking, and use the RW method to obtain its critical values. As a special weighted LADE, the feasible adaptive LADE (ALADE) is …
A semiparametric autorregresive spatial prediction model
Instituto de Economía Aplicada Litoral (IECAL-FCE-UNL), & CONICET（拉普拉塔应用经济研究所（IECAL-FCE-UNL）及阿根廷国家科学研究委员会）；Facultad de Ingeniería Química, (FIQ-UNL) & CONICET（国立圣达菲大学化学工程学院（FIQ-UNL）及阿根廷国家科学研究委员会）
A Robbins-Monro algorithm for non-parametric estimation of NAR process with Markov-Switching: asymptotic normality
Aix-Marseille University（艾克斯-马赛大学）；Escuela de Matemáticas, Facultad de Ciencias, Universidad Central de Venezuela（委内瑞拉中央大学理学院数学系）；Departamento de Matemáticas, FACYT, Universidad de Carabobo（卡拉沃博大学FACYT数学系）
For stationary sequences, under general local and asymptotic dependence restrictions, any limiting point process for time normalized upcrossings of high levels is a compound Poisson process, i.e., there is a clustering of high upcrossings, where the underlying Poisson points represent cluster positions, and the multiplicities correspond to cluster sizes. For such classes of stationary sequences there exists the upcrossings index $η,$ $0\leq η\leq 1,$ which is directly related to the extremal index $θ,$ $0\leq θ\leq 1,$ for suitable high levels. In this paper we consider the problem of estimati…
We extend classical results about the convergence of nearly unstable AR(p) processes to the infinite order case. To do so, we proceed as in recent works about Hawkes processes by using limit theorems for some well chosen geometric sums. We prove that when the coefficients sequence has a light tail, infinite order nearly unstable autoregressive processes behave as Ornstein-Uhlenbeck models. However, in the heavy tail case, we show that fractional diffusions arise as limiting laws for such processes.
This paper introduces a Nearly Unstable INteger-valued AutoRegressive Conditional Heteroskedasticity (NU-INARCH) process for dealing with count time series data. It is proved that a proper normalization of the NU-INARCH process endowed with a Skorohod topology weakly converges to a Cox-Ingersoll-Ross diffusion. The asymptotic distribution of the conditional least squares estimator of the correlation parameter is established as a functional of certain stochastic integrals. Numerical experiments based on Monte Carlo simulations are provided to verify the behavior of the asymptotic distribution u…
In this paper the asymptotic behavior of conditional least squares estimators of the autoregressive parameter for nonprimitive unstable integer-valued autoregressive models of order 2 (INAR(2)) is described.
Rutgers University（罗格斯大学）；Voleon Group（Voleon集团）；DeepMind（深度思维）；Microsoft Research（微软研究院）；Massachusetts Institute of Technology（麻省理工学院）；UC Berkeley（加州大学伯克利分校）
When data is collected in an adaptive manner, even simple methods like ordinary least squares can exhibit non-normal asymptotic behavior. As an undesirable consequence, hypothesis tests and confidence intervals based on asymptotic normality can lead to erroneous results. We propose a family of online debiasing estimators to correct these distributional anomalies in least squares estimation. Our proposed methods take advantage of the covariance structure present in the dataset and provide sharper estimates in directions for which more information has accrued. We establish an asymptotic normalit…
Birth-and-death processes are widely used to model the development of biological populations. Although they are relatively simple models, their parameters can be challenging to estimate, because the likelihood can become numerically unstable when data arise from the most common sampling schemes, such as annual population censuses. Simple estimators may be based on an embedded Galton-Watson process, but this presupposes that the observation times are equi-spaced. We estimate the birth, death, and growth rates of a linear birth-and-death process whose population size is periodically observed via…
We investigate the estimation of parameters in the random coefficient autoregressive model. We consider a nonstationary RCA process and show that the innovation variance parameter cannot be estimated by the quasi-maximum likelihood method. The asymptotic normality of the quasi-maximum likelihood estimator for the remaining model parameters is proven so the unit root problem does not exist in the random coefficient autoregressive model.
This paper considers a continuous time analogue of the classical autoregressive moving average processes, Lévy-driven CARMA processes. First we describe limiting properties of the periodogram by means of the so-called truncated Fourier transform if observations are available continuously. The obtained results are in accordance with their counterparts from the discrete-time case. Then we discuss the numerical approximation of the truncated Fourier transform based on non-equidistant high frequency data. In order to ensure convergence of the numerical approximation to the true value of the trunca…
We consider quasi maximum likelihood (QML) estimation for general non-Gaussian discrete-ime linear state space models and equidistantly observed multivariate Lévy-driven continuoustime autoregressive moving average (MCARMA) processes. In the discrete-time setting, we prove strong consistency and asymptotic normality of the QML estimator under standard moment assumptions and a strong-mixing condition on the output process of the state space model. In the second part of the paper, we investigate probabilistic and analytical properties of equidistantly sampled continuous-time state space models a…
Least squares estimator of the stability parameter $\varrho := |α| + |β|$ for a spatial unilateral autoregressive process $X_{k,\ell}=αX_{k-1,\ell}+βX_{k,\ell-1}+\varepsilon_{k,\ell}$ is investigated. Asymptotic normality with a scaling factor $n^{5/4}$ is shown in the unstable case, i.e., when $\varrho = 1$, in contrast to the AR(p) model $X_k=α_1 X_{k-1}+... +α_p X_{k-p}+ \varepsilon_k$, where the least squares estimator of the stability parameter $\varrho :=α_1 + ... + α_p$ is not asymptotically normal in the unstable, i.e., in the unit root case.
Bifurcating autoregressive processes, which can be seen as an adaptation of au-toregressive processes for a binary tree structure, have been extensively studied during the last decade in a parametric context. In this work we do not specify any a priori form for the two autoregressive functions and we use nonparametric techniques. We investigate both nonasymp-totic and asymptotic behavior of the Nadaraya-Watson type estimators of the autoregressive functions. We build our estimators observing the process on a finite subtree denoted by Tn, up to the depth n. Estimators achieve the classical rate…
This paper studies some temporal dependence properties and addresses the issue of parametric estimation for a class of state-dependent autoregressive models for nonlinear time series in which we assume a stochastic autoregressive coefficient depending on the first lagged value of the process itself. We call such a model state-dependent first-order autoregressive process, (SDAR). We introduce some assumptions under which this class of models is strictly stationary and uniformly ergodic and we establish consistency and asymptotic normality of the quasi-maximum likelihood estimator of the paramet…
We consider a class of nonparametric time series regression models in which the regressor takes values in a sequence space. Technical challenges that hampered theoretical advances in these models include the lack of associated Lebesgue density and difficulties with regard to the choice of dependence structure in the autoregressive framework. We propose an infinite-dimensional Nadaraya-Watson type estimator, and investigate its asymptotic properties in detail under both static regressive and autoregressive contexts, aiming to answer the open questions left by Linton and Sancetta (2009). First w…
A nearly unstable sequence of stationary spatial autoregressive processes is investigated, when the sum of the absolute values of the autoregressive coefficients tends to one. It is shown that after an appropriate norming the least squares estimator for these coefficients has a normal limit distribution. If none of the parameters equals zero than the typical rate of convergence is n.
This paper studies the residual empirical process of long- and short-memory time series regression models and establishes its uniform expansion under a general framework. The results are applied to the stochastic regression models and unstable autoregressive models. For the long-memory noise, it is shown that the limit distribution of the Kolmogorov-Smirnov test statistic studied in Ho and Hsing [Ann. Statist. 24 (1996) 992-1024] does not hold when the stochastic regression model includes an unknown intercept or when the characteristic polynomial of the unstable autoregressive model has a unit…
Motivated by the modeling of liquidity risk in fund management in a dynamic setting, we propose and investigate a class of time series models with generalized Pareto marginals: the autoregressive generalized Pareto process (ARGP), a modified ARGP (MARGP) and a thresholded ARGP (TARGP). These models are able to capture key data features apparent in fund liquidity data and reflect the underlying phenomena via easily interpreted, low-dimensional model parameters. We establish stationarity and ergodicity, provide a link to the class of shot-noise processes, and determine the associated interarriva…
We investigate in this paper a Bickel-Rosenblatt test of goodness-of-fit for the density of the noise in an autoregressive model. Since the seminal work of Bickel and Rosenblatt, it is well-known that the integrated squared error of the Parzen-Rosenblatt density estimator, once correctly renormalized, is asymptotically Gaussian for independent and identically distributed (i.i.d.) sequences. We show that the result still holds when the statistic is built from the residuals of general stable and explosive autoregressive processes. In the univariate unstable case, we prove that the result holds w…
We advocate the use of an Indirect Inference method to estimate the parameter of a COGARCH(1,1) process for equally spaced observations. This requires that the true model can be simulated and a reasonable estimation method for an approximate auxiliary model. We follow previous approaches and use linear projections leading to an auxiliary autoregressive model for the squared COGARCH returns. The asymptotic theory of the Indirect Inference estimator relies {on a uniform SLLN and asymptotic normality of the parameter estimates of the auxiliary model, which require continuity and differentiability…
This paper develops a unified finite-time theory for the ordinary least squares estimation of possibly unstable and even slightly explosive vector autoregressive models under linear restrictions, with the applicable region $ρ(A)\leq 1+c/n$, where $ρ(A)$ is the spectral radius of the transition matrix $A$ in the \VAR(1) representation, $n$ is the time horizon and $c>0$ is a universal constant. The linear restriction framework encompasses various existing models such as banded/network vector autoregressive models. We show that the restrictions reduce the error bounds via not only the reduced dim…
In this paper the asymptotic behavior of the conditional least squares estimators of the autoregressive parameters $(α,β)$, of the stability parameter $\varrho := α+ β$, and of the mean $μ$ of the innovation $\vare_k$, $k \in \NN$, for an unstable integer-valued autoregressive process $X_k = α\circ X_{k-1} + β\circ X_{k-2} + \vare_k$, $k \in \NN$, is described. The limit distributions and the scaling factors are different according to the following three cases: (i) decomposable, (ii) indecomposable but not positively regular, and (iii) positively regular models.
The space time autoregressive model has been widely applied in science, in areas such as economics, public finance, political science, agricultural economics, environmental studies and transportation analyses. The classical space time autoregressive model is a linear model for describing spatial correlation. In this work, we expand the classical model to include related exogenous variables, possibly non-Gaussian, high volatility errors, and a nonlinear neural network component. The nonlinear neural network component allows for more model flexibility, the ability to learn and model nonlinear an…
An autoregressive-moving average model in which all roots of the autoregressive polynomial are reciprocals of roots of the moving average polynomial and vice versa is called an all-pass time series model. All-pass models are useful for identifying and modeling noncausal and noninvertible autoregressive-moving average processes. We establish asymptotic normality and consistency for rank-based estimators of all-pass model parameters. The estimators are obtained by minimizing the rank-based residual dispersion function given by Jaeckel [Ann. Math. Statist. 43 (1972) 1449--1458]. These estimators …
