The subject of robust estimation in time series is widely discussed in literature. One of the approaches is to use GM-estimation. This method incorporates a broad class of nonparametric estimators which under suitable conditions includes estimators robust to outliers in data. For the linear models the sensitivity of GM-estimators to outliers have been studied in the work by Martin and Yohai [5], and influence functionals for this estimator were derived. In this paper we follow this direction and examine the asymptotical properties of the class of M-estimators, which is narrower than the class of GM-estimators, but gives more insight into asymptotical properties of such estimators. This paper gives an asymptotic expansion of the residual weighted empirical process, which allows to prove asymptotic normality of these estimators in case of non-smooth objective functions. For simplicity MA(1) model is considered, but it will be shown that even in this case mathematical techniques used to derive these asymptotic properties appear to be rather complicated.However, the approach used in this paper could be applied to GM-estimators and to more realistic models.
We estimate the kernel function of a symmetric alpha stable ($SαS$) moving average random function which is observed on a regular grid of points. The proposed estimator relies on the empirical normalized (smoothed) periodogram. It is shown to be weakly consistent for positive definite kernel functions, when the grid mesh size tends to zero and at the same time the observation horizon tends to infinity (high frequency observations). A simulation study shows that the estimator performs well at finite sample sizes, when the integrator measure of the moving average random function is $SαS$ and for…
This article considers a nonparametric method for detecting change points in non-stationary time series. The proposed method will divide the time series into several segments so that between two adjacent segments, the normalized spectral density functions are different. The theory is based on the assumption that within each segment, time series is a linear process, which means that our method works not only for classic time series models, e.g., causal and invertible ARMA process, but also preserves good performance for non-invertible moving average process. We show that our estimations for cha…
Estimation of the service time distribution in the discrete-time $GI/G/\infty$-queue based solely on information on the arrival and departure processes is considered. The focus is put on the estimation approach via the so called "sequence of differences". Existing results for this approach are substantially extended by proving a functional central limit theorem for the resultant estimator. Here, the underlying function space is taken to be the space of sequences converging to zero. The moving block bootstrap technique is considered for the estimation of the resultant covariance kernel and is s…
In this study, we develop an asymptotic theory of nonparametric regression for locally stationary random fields (LSRFs) $\{{\bf X}_{{\bf s}, A_{n}}: {\bf s} \in R_{n} \}$ in $\mathbb{R}^{p}$ observed at irregularly spaced locations in $R_{n} =[0,A_{n}]^{d} \subset \mathbb{R}^{d}$. We first derive the uniform convergence rate of general kernel estimators, followed by the asymptotic normality of an estimator for the mean function of the model. Moreover, we consider additive models to avoid the curse of dimensionality arising from the dependence of the convergence rate of estimators on the number…
Multivariate dynamic time series models are widely encountered in practical studies, e.g., modelling policy transmission mechanism and measuring connectedness between economic agents. To better capture the dynamics, this paper proposes a wide class of multivariate dynamic models with time-varying coefficients, which have a general time-varying vector moving average (VMA) representation, and nest, for instance, time-varying vector autoregression (VAR), time-varying vector autoregression moving-average (VARMA), and so forth as special cases. The paper then develops a unified estimation method fo…
In this paper, we are interested in the problem of smoothing parameter selection in nonparametric curve estimation under dependent errors. We focus on kernel estimation and the case when the errors form a general stationary sequence of martingale difference random variables where neither linearity assumption nor "all moments are finite" are required.We compare the behaviors of the smoothing bandwidths obtained by minimizing either the unknown average squared error, the theoretical mean average squared error, a Mallows-type criterion adapted to the dependent case and the family of criteria know…
Given a low frequency sample of an infinitely divisible moving average random field $\{\int_{\mathbb{R}^d} f(x-t)Λ(dx); \ t \in \mathbb{R}^d \}$ with a known simple function $f$, we study the problem of nonparametric estimation of the Lévy characteristics of the independently scattered random measure $Λ$. We provide three methods, a simple plug-in approach, a method based on Fourier transforms and an approach involving decompositions with respect to $L^2$-orthonormal bases, which allow to estimate the Lévy density of $Λ$. For these methods, the bounds for the $L^2$-error are given. Their numer…
In the era of big data, it is necessary to split extremely large data sets across multiple computing nodes and construct estimators using the distributed data. When designing distributed estimators, it is desirable to minimize the amount of communication across the network because transmission between computers is slow in comparison to computations in a single computer. Our work provides a general framework for understanding the behavior of distributed estimation under communication constraints for nonparametric problems. We provide results for a broad class of models, moving beyond the Gaussi…
In this paper we study the problem of statistical inference for a continuous-time moving average Lévy process of the form $$Z_{t} = \int_{\mathbb{R}}\mathcal{K}(t-s)\, dL_{s},\quad t\in\mathbb{R}$$ with a deterministic kernel (\K\) and a L{é}vy process (L\). Especially the estimation of the Lévy measure (ν\) of $L$ from low-frequency observations of the process $Z$ is considered. We construct a consistent estimator, derive its convergence rates and illustrate its performance by a numerical example. On the technical level, the main challenge is to establish a kind of exponential mixing for cont…
We identify the average dose-response function (ADRF) for a continuously valued error-contaminated treatment by a weighted conditional expectation. We then estimate the weights nonparametrically by maximising a local generalised empirical likelihood subject to an expanding set of conditional moment equations incorporated into the deconvolution kernels. Thereafter, we construct a deconvolution kernel estimator of ADRF. We derive the asymptotic bias and variance of our ADRF estimator and provide its asymptotic linear expansion, which helps conduct statistical inference. To select our smoothing p…
In this paper we study the problem of constructing bootstrap confidence intervals for the Lévy density of the driving Lévy process based on high-frequency observations of a Lévy-driven moving average processes. Using a spectral estimator of the Lévy density, we propose a novel implementations of multiplier and empirical bootstraps to construct confidence bands on a compact set away from the origin. We also provide conditions under which the confidence bands are asymptotically valid.
We consider a Lévy driven continuous time moving average process $X$ sampled at random times which follow a renewal structure independent of $X$. Asymptotic normality of the sample mean, the sample autocovariance, and the sample autocorrelation is established under certain conditions on the kernel and the random times. We compare our results to a classical non-random equidistant sampling method and give an application to parameter estimation of the Lévy driven Ornstein-Uhlenbeck process.
We demonstrate and discuss nonasymptotic bounds in probability for the cost of a regression scheme with a general loss function from the perspective of the Rademacher theory, and for the optimality with respect to the average $L^{2}$-distance to the underlying conditional expectations of least squares regression outcomes from the perspective of the Vapnik-Chervonenkis theory. The results follow from an analysis involving independent but possibly nonstationary training samples and can be extended, in a manner that we explain and illustrate, to relevant cases in which the training sample exhibit…
Gaussian Process Regression and Kernel Ridge Regression are popular nonparametric regression approaches. Unfortunately, they suffer from high computational complexity rendering them inapplicable to the modern massive datasets. To that end a number of approximations have been suggested, some of them allowing for a distributed implementation. One of them is the divide and conquer approach, splitting the data into a number of partitions, obtaining the local estimates and finally averaging them. In this paper we suggest a novel computationally efficient fully data-driven algorithm, quantifying unc…
One of the fundamental assumptions in stochastic control of continuous time processes is that the dynamics of the underlying (diffusion) process is known. This is, however, usually obviously not fulfilled in practice. On the other hand, over the last decades, a rich theory for nonparametric estimation of the drift (and volatility) for continuous time processes has been developed. The aim of this paper is bringing together techniques from stochastic control with methods from statistics for stochastic processes to find a way to both learn the dynamics of the underlying process and control in a r…
Weighted estimators are commonly used for estimating exposure effects in observational settings to establish causal relations. These estimators have a long history of development when the exposure of interest is binary and where the weights are typically functions of an estimated propensity score. Recent developments in optimization-based estimators for constructing weights in binary exposure settings, such as those based on entropy balancing, have shown more promise in estimating treatment effects than those methods that focus on the direct estimation of the propensity score using likelihood-…
Current estimation methods for the probability of causation (PC) make strong parametric assumptions or are inefficient. We derive a nonparametric influence-function-based estimator for a projection of PC, which allows for simple interpretation and valid inference by making weak structural assumptions. We apply our estimator to real data from an experiment in Kenya, which found, by estimating the average treatment effect, that protecting water springs reduces childhood disease. However, before scaling up this intervention, it is important to determine whether it was the exposure, and not someth…
A confidence sequence is a sequence of confidence intervals that is uniformly valid over an unbounded time horizon. Our work develops confidence sequences whose widths go to zero, with nonasymptotic coverage guarantees under nonparametric conditions. We draw connections between the Cramér-Chernoff method for exponential concentration, the law of the iterated logarithm (LIL), and the sequential probability ratio test -- our confidence sequences are time-uniform extensions of the first; provide tight, nonasymptotic characterizations of the second; and generalize the third to nonparametric settin…
Consider measured positions of the paleomagnetic north pole over time. Each measured position may be viewed as a direction, expressed as a unit vector in three dimensions and incorporating some error. In this sequence, the true directions are expected to be close to one another at nearby times. A simple trend estimator that respects the geometry of the sphere is to compute a running average over the time-ordered observed direction vectors, then normalize these average vectors to unit length. This paper treats a considerably richer class of competing directional trend estimators that respect sp…
We argue that randomized controlled trials (RCTs) are special even among settings where average treatment effects are identified by a nonparametric unconfoundedness assumption. This claim follows from two results of Robins and Ritov (1997): (1) with at least one continuous covariate control, no estimator of the average treatment effect exists which is uniformly consistent without further assumptions, (2) knowledge of the propensity score yields a uniformly consistent estimator and honest confidence intervals that shrink at parametric rates with increasing sample size, regardless of how complic…
We consider a new method of the semiparametric statistical estimation for the continuous-time moving average Lévy processes. We derive the convergence rates of the proposed estimators, and show that these rates are optimal in the minimax sense.
This paper proposes the beta binomial autoregressive moving average model (BBARMA) for modeling quantized amplitude data and bounded count data. The BBARMA model estimates the conditional mean of a beta binomial distributed variable observed over the time by a dynamic structure including: (i) autoregressive and moving average terms; (ii) a set of regressors; and (iii) a link function. Besides introducing the new model, we develop parameter estimation, detection tools, an out-of-signal forecasting scheme, and diagnostic measures. In particular, we provide closed-form expressions for the conditi…
Spatial heteroskedasticity refers to stochastically changing variances and covariances in space. Such features have been observed in, for example, air pollution and vegetation data. We study how volatility modulated moving averages can model this by developing theory, simulation and statistical inference methods. For illustration, we also apply our procedure to sea surface temperature anomaly data from the International Research Institute for Climate and Society.
One of the most widely applied unit root test, Phillips-Perron test, enjoys in general highpowers, but suffers from size distortions when moving average noise exists. As a remedy, thispaper proposes a nonparametric bootstrap unit root test that specifically targets moving aver-age noise. Via a bootstrap functional central limit theorem, the consistency of this bootstrapapproach is established under general assumptions which allows a large family of non-linear timeseries. In simulation, this bootstrap test alleviates the size distortions of the Phillips-Perrontest while preserving its high powe…
In this paper we introduce the class of beta seasonal autoregressive moving average ($β$SARMA) models for modeling and forecasting time series data that assume values in the standard unit interval. It generalizes the class of beta autoregressive moving average models [Rocha and Cribari-Neto, Test, 2009] by incorporating seasonal dynamics to the model dynamic structure. Besides introducing the new class of models, we develop parameter estimation, hypothesis testing inference, and diagnostic analysis tools. We also discuss out-of-sample forecasting. In particular, we provide closed-form expressi…
We consider the issue of performing accurate small sample inference in beta autoregressive moving average model, which is useful for modeling and forecasting continuous variables that assumes values in the interval $(0,1)$. The inferences based on conditional maximum likelihood estimation have good asymptotic properties, but their performances in small samples may be poor. This way, we propose bootstrap bias corrections of the point estimators and different bootstrap strategies for confidence interval improvements. Our Monte Carlo simulations show that finite sample inference based on bootstra…
It is an important task in the literature to check whether a fitted autoregressive moving average (ARMA) model is adequate, while the currently used tests may suffer from the size distortion problem when the underlying autoregressive models have low persistence. To fill this gap, this paper proposes two empirical likelihood-based portmanteau tests. The first one is naive but can serve as a benchmark, and the second is for the case with infinite variance innovations. The asymptotic distributions under the null hypothesis are derived under mild moment conditions, and their usefulness is demonstr…
In this paper we introduce the Kumaraswamy autoregressive moving average models (KARMA), which is a dynamic class of models for time series taking values in the double bounded interval $(a,b)$ following the Kumaraswamy distribution. The Kumaraswamy family of distribution is widely applied in many areas, especially hydrology and related fields. Classical examples are time series representing rates and proportions observed over time. In the proposed KARMA model, the median is modeled by a dynamic structure containing autoregressive and moving average terms, time-varying regressors, unknown param…
We propose a novel approach for density estimation called histogram trend filtering. Our estimator arises from looking at surrogate Poisson model for counts of observations in a partition of the support of the data. We begin by showing consistency for a variational estimator for this density estimation problem. We then study a discrete estimator that can be efficiently found via convex optimization. We show that the estimator enjoys strong statistical guarantees, yet is much more practical and computationally efficient than other estimators that enjoy similar guarantees. Finally, in our simula…
In this work we introduce the class of beta autoregressive fractionally integrated moving average models for continuous random variables taking values in the continuous unit interval $(0,1)$. The proposed model accommodates a set of regressors and a long-range dependent time series structure. We derive the partial likelihood estimator for the parameters of the proposed model, obtain the associated score vector and Fisher information matrix. We also prove the consistency and asymptotic normality of the estimator under mild conditions. Hypotheses testing, diagnostic tools and forecasting are als…
Nonparametric methodologies are proposed to assess college students' performance. Emphasis is given to gender and sector of High School. The application concerns the University of Campinas, a research university in Southeast Brazil. In Brazil college is based on a somewhat rigid set of subjects for each major. Thence a student's relative performance can not be accurately measured by the Grade Point Average or by any other single measure. We then define individual vectors of course grades. These vectors are used in pairwise comparisons of common subject grades for individuals that entered colle…
This paper considers estimation and inference for a weighted average derivative (WAD) of a nonparametric quantile instrumental variables regression (NPQIV). NPQIV is a non-separable and nonlinear ill-posed inverse problem, which might be why there is no published work on the asymptotic properties of any estimator of its WAD. We first characterize the semiparametric efficiency bound for a WAD of a NPQIV, which, unfortunately, depends on an unknown conditional derivative operator and hence an unknown degree of ill-posedness, making it difficult to know if the information bound is singular or not…
The research in this paper gives a systematic investigation on the asymptotic behaviours of four inverse probability weighting (IPW)-based estimators for conditional average treatment effect, with nonparametrically, semiparametrically, parametrically estimated and true propensity score, respectively. To this end, we first pay a particular attention to semiparametric dimension reduction structure such that we can well study the semiparametric-based estimator that can well alleviate the curse of dimensionality and greatly avoid model misspecification. We also derive some further properties of ex…
We consider a mixed moving average (MMA) process X driven by a Lévy basis and prove that it is weakly dependent with rates computable in terms of the moving average kernel and the characteristic quadruple of the Lévy basis. Using this property, we show conditions ensuring that sample mean and autocovariances of X have a limiting normal distribution. We extend these results to stochastic volatility models and then investigate a Generalized Method of Moments estimator for the supOU process and the supOU stochastic volatility model after choosing a suitable distribution for the mean reversion par…
For a stationary moving average random field, a non-parametric low frequency estimator of the Lévy density of its infinitely divisible independently scattered integrator measure is given. The plug-in estimate is based on the solution $w$ of the linear integral equation $v(x) = \int_{\mathbb{R}^d} g(s) w(h(s)x)ds$, where $g,h:\mathbb{R}^d \rightarrow \mathbb{R}$ are given measurable functions and $v$ is a (weighted) $L^2$-function on $\mathbb{R}$. We investigate conditions for the existence and uniqueness of this solution and give $L^2$-error bounds for the resulting estimates. An application t…
Given discrete time observations over a fixed time interval, we study a nonparametric Bayesian approach to estimation of the volatility coefficient of a stochastic differential equation. We postulate a histogram-type prior on the volatility with piecewise constant realisations on bins forming a partition of the time interval. The values on the bins are assigned an inverse Gamma Markov chain (IGMC) prior. Posterior inference is straightforward to implement via Gibbs sampling, as the full conditional distributions are available explicitly and turn out to be inverse Gamma. We also discuss in deta…
We present a novel family of nonparametric omnibus tests of the hypothesis that two unknown but estimable functions are equal in distribution when applied to the observed data structure. We developed these tests, which represent a generalization of the maximum mean discrepancy tests described in Gretton et al. [2006], using recent developments from the higher-order pathwise differentiability literature. Despite their complex derivation, the associated test statistics can be expressed rather simply as U-statistics. We study the asymptotic behavior of the proposed tests under the null hypothesis…
