This article gives a synopsis on new developments in affine invariant tests for multivariate normality in an i.i.d.-setting, with special emphasis on asymptotic properties of several classes of weighted $L^2$-statistics. Since weighted $L^2$-statistics typically have limit normal distributions under fixed alternatives to normality, they open ground for a neighborhood of model validation for normality. The paper also reviews several other invariant tests for this problem, notably the energy test, and it presents the results of a large-scale simulation study. All tests under study are implemented in the accompanying R-package mnt.
In this paper, the maximum spacing method is considered for multivariate observations. Nearest neighbour balls are used as a multidimensional analogue to univariate spacings. A class of information-type measures is used to generalize the concept of maximum spacing estimators. Asymptotic normality of these generalized maximum spacing estimators is proved when the assigned model class is correct, that is the true density is a member of the model class.
We consider the problem of testing multivariate normality when the data consists of a random sample of two-step monotone incomplete observations. We define for such data a generalization of Mardia's statistic for measuring kurtosis, derive the asymptotic non-null distribution of the statistic under certain regularity conditions and against a broad class of alternatives, and give an application to a well-known data set on cholesterol measurements.
In multivariate statistics, acyclic mixed graphs with directed and bidirected edges are widely used for compact representation of dependence structures that can arise in the presence of hidden (i.e., latent or unobserved) variables. Indeed, under multivariate normality, every mixed graph corresponds to a set of covariance matrices that contains as a full-dimensional subset the covariance matrices associated with a causally interpretable acyclic digraph. This digraph generally has some of its nodes corresponding to hidden variables. We seek to clarify for which mixed graphs there exists an acyc…
Multivariate processes with long-range dependence properties can be encountered in many fields of application. Two fundamental characteristics in such frameworks are long-range dependence parameters and correlations between component time series. We consider multivariate long-range dependent linear processes, not necessarily Gaussian. We show that the covariances between the wavelet coefficients in this setting are asymptotically Gaussian. We also study the asymptotic distributions of the estimators of the long-range dependence parameter and the long-run covariance by a wavelet-based Whittle p…
We propose new affine invariant tests for multivariate normality, based on independence characterizations of the sample moments of the normal distribution. The test statistics are obtained using canonical correlations between sets of sample moments, generalizing the Lin-Mudholkar test for normality. The tests are compared to some popular tests based on Mardia's skewness and kurtosis measures in an extensive simulation power study and are found to offer higher power against many of the alternatives.
In this paper, a novel Bayesian nonparametric test for assessing multivariate normal models is presented. While there are extensive frequentist and graphical methods for testing multivariate normality, it is challenging to find Bayesian counterparts. The proposed approach is based on the use of the Dirichlet process and Mahalanobis distance. More precisely, the Mahalanobis distance is employed as a good technique to transform the $m$-variate problem into a univariate problem. Then the Dirichlet process is used as a prior on the distribution of the Mahalanobis distance. The concentration of the…
A multivariable measurement error model $AX \approx B$ is considered. Here $A$ and $B$ are input and output matrices of measurements and $X$ is a rectangular matrix of fixed size to be estimated. The errors in $[A,B]$ are row-wise independent, but within each row the errors may be correlated. Some of the columns are observed without errors and the error covariance matrices may differ from row to row. The total covariance structure of the errors is known up to a scalar factor. The fully weighted total least squares estimator of $X$ is studied. We give conditions for asymptotic normality of the …
Strong consistency and asymptotic normality of the Quasi-Maximum Likelihood Estimator (QMLE) are given for a general class of multidimensional causal processes. For particular cases already studied in the literature (for instance univariate or multivariate GARCH, ARCH, ARMA-GARCH processes) the assumptions required for establishing these results are often weaker than existing conditions. The QMLE asymptotic behavior is also given for numerous new examples of univariate or multivariate processes (for instance TARCH or NLARCH processes).
We study a novel class of affine invariant and consistent tests for multivariate normality. The tests are based on a characterization of the standard $d$-variate normal distribution by means of the unique solution of an initial value problem connected to a partial differential equation, which is motivated by a multivariate Stein equation. The test criterion is a suitably weighted $L^2$-statistic. We derive the limit distribution of the test statistic under the null hypothesis as well as under contiguous and fixed alternatives to normality. A consistent estimator of the limiting variance under …
We study a novel class of affine invariant and consistent tests for normality in any dimension. The tests are based on a characterization of the standard $d$-variate normal distribution as the unique solution of an initial value problem of a partial differential equation motivated by the harmonic oscillator, which is a special case of a Schrödinger operator. We derive the asymptotic distribution of the test statistics under the hypothesis of normality as well as under fixed and contiguous alternatives. The tests are consistent against general alternatives, exhibit strong power performance for …
This paper deals with testing for nondegenerate normality of a $d$-variate random vector $X$ based on a random sample $X_1,\ldots,X_n$ of $X$. The rationale of the test is that the characteristic function $ψ(t) = \exp(-\|t\|^2/2)$ of the standard normal distribution in $\mathbb{R}^d$ is the only solution of the partial differential equation $Δf(t) = (\|t\|^2-d)f(t)$, $t \in \mathbb{R}^d$, subject to the condition $f(0) = 1$. By contrast with a recent approach that bases a test for multivariate normality on the difference $Δψ_n(t)-(\|t\|^2-d)ψ(t)$, where $ψ_n(t)$ is the empirical characteristic…
Asymptotic normality of intermediate order statistics taken from univariate iid random variables is well-known. We generalize this result to random vectors in arbitrary dimension, where the order statistics are taken componentwise.
We establish asymptotic normality for estimators of the additive regression components under random censorship. To build our estimators, we couple the marginal integration method (Newey (1994)) with an initial Inverse Probability of Censoring Weighted estimator of the multivariate censored regression function introduced by Carbonez et al. (1995) and Kohler et al. (2002). Asymptotic confidence bands are derived from our result.
The problem of characterizing a multivariate distribution of a random vector using examination of univariate combinations of vector components is an essential issue of multivariate analysis. The likelihood principle plays a prominent role in developing powerful statistical inference tools. In this context, we raise the question: can the univariate likelihood function based on a random vector be used to provide the uniqueness in reconstructing the vector distribution? In multivariate normal (MN) frameworks, this question links to a reverse of Cochran's theorem that concerns the distribution of …
In multivariate regression estimation, the rate of convergence depends on the dimension of the regressor. This fact, known as the curse of the dimensionality, motivated several works. The additive model, introduced by Stone (10), offers an efficient response to this problem. In the setting of continuous time processes, using the marginal integration method, we obtain the quadratic convergence rate and the asymptotic normality of the components of the additive model.
Consider testing normality against a one-parameter family of univariate distributions containing the normal distribution as the boundary, e.g., the family of $t$-distributions or an infinitely divisible family with finite variance. We prove that under mild regularity conditions, the sample skewness is the locally best invariant (LBI) test of normality against a wide class of asymmetric families and the kurtosis is the LBI test against symmetric families. We also discuss non-regular cases such as testing normality against the stable family and some related results in the multivariate cases.
We consider estimation of the covariance matrix of a multivariate random vector under the constraint that certain covariances are zero. We first present an algorithm, which we call Iterative Conditional Fitting, for computing the maximum likelihood estimator of the constrained covariance matrix, under the assumption of multivariate normality. In contrast to previous approaches, this algorithm has guaranteed convergence properties. Dropping the assumption of multivariate normality, we show how to estimate the covariance matrix in an empirical likelihood approach. These approaches are then compa…
In this paper, we compute doubly truncated moments for the selection elliptical (SE) class of distributions, which includes some multivariate asymmetric versions of well-known elliptical distributions, such as, the normal, Student's t, slash, among others. We address the moments for doubly truncated members of this family, establishing neat formulation for high order moments as well as for its first two moments. We establish sufficient and necessary conditions for the existence of these truncated moments. Further, we propose optimized methods able to deal with extreme setting of the parameters…
This work includes a new characterization of the multivariate normal distribution. In particular, it is shown that a positive density function $f$ is Gaussian if and only if the $f(x+ y)/f(x)$ is convex in $x$ for every $y$. This result has implications to recent research regarding inadmissibility of a test studied by Moran~(1973).
We use a system of first-order partial differential equations that characterize the moment generating function of the $d$-variate standard normal distribution to construct a class of affine invariant tests for normality in any dimension. We derive the limit null distribution of the resulting test statistics, and we prove consistency of the tests against general alternatives. In the case $d > 1$, a certain limit of these tests is connected with two measures of multivariate skewness. The new tests show strong power performance when compared to well-known competitors, especially against heavy-tai…
The asymptotic normality of the maximum likelihood estimator (MLE) under regularity conditions is a cornerstone of statistical theory. In this paper, we give explicit upper bounds on the distributional distance between the distribution of the MLE of a vector parameter, and the multivariate normal distribution. We work with possibly high-dimensional, independent but not necessarily identically distributed random vectors. In addition, we obtain explicit upper bounds even in cases where the MLE cannot be expressed analytically.
We study weighted M-estimators for $\mathbb{R}^d$-valued clustered data and give sufficient conditions for their consistency. Their asymptotic normality is established with estimation of the asymptotic covariance matrix. We address the robustness of these estimators in terms of their breakdown point. Comparison with the unweighted case is performed with some numerical studies. They highlight that optimal weights maximizing the relative efficiency have a bad impact on the breakdown point.
We provide novel characterizations of multivariate normality that incorporate both the characteristic function and the moment generating function, and we employ these results to construct a class of affine invariant, consistent and easy-to-use goodness-of-fit tests for normality. The test statistics are suitably weighted $L^2$-statistics, and we provide their asymptotic behavior both for i.i.d. observations as well as in the context of testing that the innovation distribution of a multivariate GARCH model is Gaussian. We also study the finite-sample behavior of the new tests and compare the ne…
A framework for assessing the matrix variate normality of three-way data is developed. The framework comprises a visual method and a goodness of fit test based on the Mahalanobis squared distance (MSD). The MSD of multivariate and matrix variate normal estimators, respectively, are used as an assessment tool for matrix variate normality. Specifically, these are used in the form of a distance-distance (DD) plot as a graphical method for visualizing matrix variate normality. In addition, we employ the popular Kolmogorov-Smirnov goodness of fit test in the context of assessing matrix variate norm…
This paper is concerned with testing normality in a Hilbert space based on the maximum mean discrepancy. Specifically, we discuss the behavior of the test from two standpoints: asymptotics and practical aspects. Asymptotic normality of the test under a fixed alternative hypothesis is developed, which implies that the test has consistency. Asymptotic distribution of the test under a sequence of local alternatives is also derived, from which asymptotic null distribution of the test is obtained. A concrete expression for the integral kernel associated with the null distribution is derived under t…
The main Theorem of Jain et al.[Jain, K., Singh, S., and Sharma, S. (2011), Re- stricted estimation in multivariate measurement error regression model; JMVA, 102, 2, 264-280] is established in its full generality. Namely, we derive the joint asymp- totic normality of the unrestricted estimator (UE) and the restricted estimators of the matrix of the regression coefficients. The derived result holds under the hypothesized restriction as well as under the sequence of alternative restrictions. In addition, we establish Asymptotic Distributional Risk for the estimators and compare their relative pe…
Many statistical methodologies for high-dimensional data assume the population is normal. Although a few multivariate normality tests have been proposed, to the best of our knowledge, none of them can properly control the type I error when the dimension is larger than the number of observations. In this work, we propose a novel nonparametric test that utilizes the nearest neighbor information. The proposed method guarantees the asymptotic type I error control under the high-dimensional setting. Simulation studies verify the empirical size performance of the proposed test when the dimension gro…
It is well known that under general regularity conditions the distribution of the maximum likelihood estimator (MLE) is asymptotically normal. Very recently, bounds of the optimal order $O(1/\sqrt n)$ on the closeness of the distribution of the MLE to normality in the so-called bounded Wasserstein distance were obtained, where $n$ is the sample size. However, the corresponding bounds on the Kolmogorov distance were only of the order $O(1/n^{1/4})$. In this note, bounds of the optimal order $O(1/\sqrt n)$ on the closeness of the distribution of the MLE to normality in the Kolmogorov distance ar…
Uniform and nonuniform Berry--Esseen (BE) bounds of optimal orders on the closeness to normality for general abstract nonlinear statistics are given, which are then used to obtain optimal bounds on the rate of convergence in the delta method for vector statistics. Specific applications to Pearson's, non-central Student's and Hotelling's statistics, sphericity test statistics, a regularized canonical correlation, and maximum likelihood estimators (MLEs) are given; all these uniform and nonuniform BE bounds appear to be the first known results of these kinds, except for uniform BE bounds for MLE…
This is an expository account of the edge eigenvalue distributions in random matrix theory and their application in multivariate statistics. The emphasis is on the Painlevé representations of these distributions.
We present a unified approach to goodness-of-fit testing in $\mathbb{R}^d$ and on lower-dimensional manifolds embedded in $\mathbb{R}^d$ based on sums of powers of weighted volumes of $k$-th nearest neighbor spheres. We prove asymptotic normality of a class of test statistics under the null hypothesis and under fixed alternatives. Under such alternatives, scaled versions of the test statistics converge to the $α$-entropy between probability distributions. A simulation study shows that the procedures are serious competitors to established goodness-of-fit tests.
We present new families of goodness-of-fit tests of uniformity on a full-dimensional set $W\subset\R^d$ based on statistics related to edge lengths of random geometric graphs. Asymptotic normality of these statistics is proven under the null hypothesis as well as under fixed alternatives. The derived tests are consistent and their behaviour for some contiguous alternatives can be controlled. A simulation study suggests that the procedures can compete with or are better than established goodness-of-fit tests. We show with a real data example that the new tests can detect non-uniformity of a sma…
There has been a wide interest to extend univariate and multivariate nonparametric procedures to clustered and hierarchical data. Traditionally, parametric mixed models have been used to account for the correlation structures among the dependent observational units. In this work we extend multivariate nonparametric procedures for one-sample and several samples location problems to clustered data settings. The results are given for a general score function, but with an emphasis on spatial sign and rank methods. Mixed models notation involving design matrices for fixed and random effects is used…
We generalize a recent class of tests for univariate normality that are based on the empirical moment generating function to the multivariate setting, thus obtaining a class of affine invariant, consistent and easy-to-use goodness-of-fit tests for multinormality. The test statistics are suitably weighted $L^2$-statistics, and we provide their asymptotic behavior both for i.i.d. observations as well as in the context of testing that the innovation distribution of a multivariate GARCH model is Gaussian. We study the finite-sample behavior of the new tests, compare the criteria with alternative e…
This survey reviews the existing literature on the most relevant Bayesian inference methods for univariate and multivariate GARCH models. The advantages and drawbacks of each procedure are outlined as well as the advantages of the Bayesian approach versus classical procedures. The paper makes emphasis on recent Bayesian non-parametric approaches for GARCH models that avoid imposing arbitrary parametric distributional assumptions. These novel approaches implicitly assume infinite mixture of Gaussian distributions on the standardized returns which have been shown to be more flexible and describe…
In group sequential analysis, data is collected and analyzed in batches until pre-defined stopping criteria are met. Inference in the parametric setup typically relies on the limiting asymptotic multivariate normality of the repeatedly computed maximum likelihood estimators (MLEs), a result first rigorously proved by Jennison and Turbull (1997) under general regularity conditions. In this work, using Stein's method we provide optimal order, non-asymptotic bounds on the distance for smooth test functions between the joint group sequential MLEs and the appropriate normal distribution under the s…
We develop a quasi-likelihood analysis procedure for a general class of multivariate marked point processes. As a by-product of the general method, we establish under stability and ergodicity conditions the local asymptotic normality of the quasi-log likelihood, along with the convergence of moments of quasi-likelihood and quasi-Bayesian estimators. To illustrate the general approach, we then turn our attention to a class of multivariate marked Hawkes processes with generalized exponential kernels, comprising among others the so-called Erlang kernels. We provide explicit conditions on the kern…
