We derive the form of the variance-covariance matrix for any affine equivariant matrix-valued statistics when sampling from complex elliptical distributions. We then use this result to derive the variance-covariance matrix of the sample covariance matrix (SCM) as well as its theoretical mean squared error (MSE) when finite fourth-order moments exist. Finally, illustrative examples of the formulas are presented.
This paper discusses fluctuations of linear spectral statistics of high-dimensional sample covariance matrices when the underlying population follows an elliptical distribution. Such population often possesses high order correlations among their coordinates, which have great impact on the asymptotic behaviors of linear spectral statistics. Taking such kind of dependency into consideration, we establish a new central limit theorem for the linear spectral statistics in this paper for a class of elliptical populations. This general theoretical result has wide applications and, as an example, it i…
We develop tests for high-dimensional covariance matrices under a generalized elliptical model. Our tests are based on a central limit theorem (CLT) for linear spectral statistics of the sample covariance matrix based on self-normalized observations. For testing sphericity, our tests neither assume specific parametric distributions nor involve the kurtosis of data. More generally, we can test against any non-negative definite matrix that can even be not invertible. As an interesting application, we illustrate in empirical studies that our tests can be used to test uncorrelatedness among idiosy…
Elliptically symmetric distributions are widely used in portfolio modeling, as well as in signal processing applications for modeling impulsive background noises. Of particular interest are algorithms for covariance estimation and subspace detection in such backgrounds. This article tackles the issue of correctly estimating the covariance matrix associated to such models and detecting additional signal superimposed on such distributions. A particular attention is given to the proper accounting of the circular symmetry for the subclass of complex elliptical distributions in the case of complex …
The main objective of this work is to calculate the multivariate double truncated expectation (MDTE) and covariance (MDTCov) for elliptical distributions. We also consider double truncated expectation (DTE) and variance (DTV) for univariate elliptical distributions. The exact expressions of MDTE and MDTCov are derived for some special cases of the family, such as normal, student-$t$, logistic, Laplace and Pearson type VII distributions. As numerical illustration, the DTE, DTV, MDTE and MDTCov for normal distribution are computed in details. Finally, we discuss MDTE and MDTCov of three industry…
We address structured covariance estimation in Elliptical distribution. We assume it is a priori known that the covariance belongs to a given convex set, e.g., the set of Toeplitz or banded matrices. We consider the General Method of Moments (GMM) optimization subject to these convex constraints. Unfortunately, GMM is still non-convex due to objective. Instead, we propose COCA - a convex relaxation which can be efficiently solved. We prove that the relaxation is tight in the unconstrained case for a finite number of samples, and in the constrained case asymptotically. We then illustrate the ad…
Spatial-sign covariance matrix (SSCM) is an important substitute of sample covariance matrix (SCM) in robust statistics. This paper investigates the SSCM on its asymptotic spectral behaviors under high-dimensional elliptical populations, where both the dimension $p$ of observations and the sample size $n$ tend to infinity with their ratio $p/n\to c\in (0, \infty)$. The empirical spectral distribution of this nonparametric scatter matrix is shown to converge in distribution to a generalized Marčenko-Pastur law. Beyond this, a new central limit theorem (CLT) for general linear spectral statistic…
Let $X$ be an $M\times N$ random matrix consisting of independent $M$-variate elliptically distributed column vectors $\mathbf{x}_{1},\dots,\mathbf{x}_{N}$ with general population covariance matrix $Σ$. In the literature, the quantity $XX^{*}$ is referred to as the sample covariance matrix after scaling, where $X^{*}$ is the transpose of $X$. In this article, we prove that the limiting behavior of the scaled largest eigenvalue of $XX^{*}$ is universal for a wide class of elliptical distributions, namely, the scaled largest eigenvalue converges weakly to the same limit regardless of the distrib…
In this paper, the multivariate tail covariance (MTCov) for generalized skew-elliptical distributions is considered. Some special cases for this distribution, such as generalized skew-normal, generalized skew student-t, generalized skew-logistic and generalized skew-Laplace distributions, are also considered. In order to test the theoretical feasibility of our results, the MTCov for skewed and non skewed normal distributions are computed and compared. Finally, we give a special formula of the MTCov for generalized skew-elliptical distributions.
Robustness to outliers is often a desirable property of statistical estimators. Indeed many well known estimators offer very good optimal performance in theory but are unusable in applied contexts because of their sensitivity to outliers. Of particular interest to the authors is the case of covariance estimators in adaptive matched filtering schemes in signal processing applications such as RADAR and SONAR detection, for which a contamination by outliers of the estimated noise covariance can lead to a great impact on performances, in particular when these outliers are similar to the target sig…
Standard statistical methods applied to matrix random variables often fail to describe the underlying structure in multiway data sets. In this paper we will discuss the concept of an array variate random variable and introduce a class of elliptical array densities which have elliptical contours.
In this short note we provide an analytical formula for the conditional covariance matrices of the elliptically distributed random vectors, when the conditioning is based on the values of any linear combination of the marginal random variables. We show that one could introduce the univariate invariant depending solely on the conditioning set, which greatly simplifies the calculations. As an application, we show that one could define uniquely defined quantile-based sets on which conditional covariance matrices must be equal to each other if only the vector is multivariate normal. The similar re…
The maximum likelihood principle is widely used in statistics, and the associated estimators often display good properties. indeed maximum likelihood estimators are guaranteed to be asymptotically efficient under mild conditions. However in some settings, one has too few samples to get a good estimation. It then becomes desirable to take into account prior information about the distribution one wants to estimate. One possible approach is to extend the maximum likelihood principle in a bayesian context, which then becomes a maximum a posteriori estimate; however this requires a distribution mod…
The asymptotic efficiency of the spatial sign covariance matrix (SSCM) relative to affine equivariant estimates of scatter is studied in detail. In particular, the SSCM is shown to be asymptoticaly inadmissible, i.e. the asymptotic variance-covariance matrix of the consistency corrected SSCM is uniformly smaller than that of its affine equivariant counterpart, namely Tyler's scatter matrix. Although the SSCM has often been recommended when one is interested in principal components analysis, the degree of the inefficiency of the SSCM is shown to be most severe in situations where principal comp…
In this paper, we focus on multivariate doubly truncated first two moments of generalized skew-elliptical (GSE) distributions and derive explicit expressions for them. It includes many useful distributions, for examples, generalized skew-normal (GSN), generalized skew-Laplace (GSLa), generalized skew-logistic (GSLo) and generalized skew student-$t$ (GSSt) distributions, all as special cases. We also give formulas of multivariate doubly truncated expectation and covariance for GSE distributions. As applications, we show the results of multivariate tail conditional expectation (MTCE) and multiva…
This paper analyzes the performance of Tyler's M-estimator of the scatter matrix in elliptical populations. We focus on the non-asymptotic setting and derive the estimation error bounds depending on the number of samples n and the dimension p. We show that under quite mild conditions the squared Frobenius norm of the error of the inverse estimator decays like p^2/n with high probability.
In this paper, we consider the problem of estimating the $p\times p$ scale matrix $Σ$ of a multivariate linear regression model $Y=X\,β+ \mathcal{E}\,$ when the distribution of the observed matrix $Y$ belongs to a large class of elliptically symmetric distributions. After deriving the canonical form $(Z^T U^T)^T$ of this model, any estimator $\hat{ Σ}$ of $Σ$ is assessed through the data-based loss tr$(S^{+}Σ\, (Σ^{-1}\hatΣ - I_p)^2 )\,$ where $S=U^T U$ is the sample covariance matrix and $S^{+}$ is its Moore-Penrose inverse. We provide alternative estimators to the usual estimators $a\,S$, wh…
We gather several results on the eigenvalues of the spatial sign covariance matrix of an elliptical distribution. It is shown that the eigenvalues are a one-to-one function of the eigenvalues of the shape matrix and that they are closer together than the latter. We further provide a one-dimensional integral representation of the eigenvalues, which facilitates their numerical computation.
This paper is concerned with the small area estimation in the multivariate Fay-Herriot model where covariance matrix of random effects are fully unknown. The covariance matrix is estimated by a Prasad-Rao type consistent estimator, and the empirical best linear un- biased predictor (EBLUP) of a vector of small area characteristics is provided. When the EBLUP is measured in terms of a mean squared error matrix (MSEM), a second-order approximation of MSEM of the EBLUP and a second-order unbiased estimator of the MSEM is derived analytically in closed forms. The performance is investigated throug…
Estimating a high-dimensional sparse covariance matrix from a limited number of samples is a fundamental problem in contemporary data analysis. Most proposals to date, however, are not robust to outliers or heavy tails. Towards bridging this gap, in this work we consider estimating a sparse shape matrix from $n$ samples following a possibly heavy tailed elliptical distribution. We propose estimators based on thresholding either Tyler's M-estimator or its regularized variant. We derive bounds on the difference in spectral norm between our estimators and the shape matrix in the joint limit as th…
This paper investigates limiting properties of eigenvalues of multivariate sample spatial-sign covariance matrices when both the number of variables and the sample size grow to infinity. The underlying p-variate populations are general enough to include the popular independent components model and the family of elliptical distributions. A first result of the paper establishes that the distribution of the eigenvalues converges to a deterministic limit that belongs to the family of generalized Marcenko-Pastur distributions. Furthermore, a new central limit theorem is established for a class of l…
The $k$ principal points of a random vector $\mathbf{X}$ are defined as a set of points which minimize the expected squared distance between $\mathbf{X}$ and the nearest point in the set. They are thoroughly studied in Flury (1990, 1993), Tarpey (1995) and Tarpey, Li and Flury (1995). For their treatment, the examination is usually restricted to the family of elliptical distributions. In this paper, we present an extension of the previous results to the functional elliptical distribution case, i.e., when dealing with random elements over a separable Hilbert space ${\cal H}$. Principal points f…
We study the estimation of the covariance matrix $Σ$ of a $p$-dimensional normal random vector based on $n$ independent observations corrupted by additive noise. Only a general nonparametric assumption is imposed on the distribution of the noise without any sparsity constraint on its covariance matrix. In this high-dimensional semiparametric deconvolution problem, we propose spectral thresholding estimators that are adaptive to the sparsity of $Σ$. We establish an oracle inequality for these estimators under model miss-specification and derive non-asymptotic minimax convergence rates that are …
Many inference techniques for multivariate data analysis assume that the rows of the data matrix are realizations of independent and identically distributed random vectors. Such an assumption will be met, for example, if the rows of the data matrix are multivariate measurements on a set of independently sampled units. In the absence of an independent random sample, a relevant question is whether or not a statistical model that assumes such row exchangeability is plausible. One method for assessing this plausibility is a statistical test of row covariation. Maintenance of a constant type I erro…
In this paper, we consider the spectrum sensing in cognitive radio networks when the impulsive noise appears. We propose a class of blind and robust detectors using M-estimators in eigenvalue based spectrum sensing method. The conventional eigenvalue based method uses statistics derived from the eigenvalues of sample covariance matrix(SCM) as testing statistics, which are inefficient and unstable in the impulsive noise environment. Instead of SCM, we can use M-estimators, which have good performance under both impulsive and non-impulsive noise. Among those M-estimators, We recommend the Tyler'…
High-Dimensional Regularization of the Spatial Sign Covariance Matrix for Robust Shape Estimation
Whiting School of Engineering, Johns Hopkins University（约翰斯·霍普金斯大学惠廷工程学院）；Department of Applied Mathematics and Statistics, Johns Hopkins University（约翰斯·霍普金斯大学应用数学与统计学系）；Department of Statistics & Data Science Institute, University of Chicago（芝加哥大学统计与数据科学研究所）
In this work we consider the problem of estimating a high-dimensional $p \times p$ covariance matrix $Σ$, given $n$ observations of confounded data with covariance $Σ+ ΓΓ^T$, where $Γ$ is an unknown $p \times q$ matrix of latent factor loadings. We propose a simple and scalable estimator based on the projection on to the right singular vectors of the observed data matrix, which we call RSVP. Our theoretical analysis of this method reveals that in contrast to PCA-based approaches, RSVP is able to cope well with settings where the smallest eigenvalue of $Γ^T Γ$ is close to the largest eigenvalue…
We propose a simple stochastic process for modeling improper or noncircular complex-valued signals. The process is a natural extension of a complex-valued autoregressive process, extended to include a widely linear autoregressive term. This process can then capture elliptical, as opposed to circular, stochastic oscillations in a bivariate signal. The process is order one and is more parsimonious than alternative stochastic modeling approaches in the literature. We provide conditions for stationarity, and derive the form of the covariance and relation sequence of this model. We describe how par…
