In the present paper, we first discuss the Kendall rank correlation coefficient. In continuous case, we define the Kendall rank correlation coefficient in terms of the concomitants of order statistics, find the expected value of the Kendall rank correlation coefficient and show that the later is free of n. We also prove that in continuous case the Kendall correlation coefficient converges in probability to its expected value. We then propose to consider the expected value of the Kendall rank correlation coefficient as a new theoretical correlation coefficient which can be an alternative to the classical Pearson product-moment correlation coefficient. At the end of this work we analyze illustrative examples.
For a bivariate time series $((X_i,Y_i))_{i=1,...,n}$ we want to detect whether the correlation between $X_i$ and $Y_i$ stays constant for all $i = 1,...,n$. We propose a nonparametric change-point test statistic based on Kendall's tau and derive its asymptotic distribution under the null hypothesis of no change by means a new U-statistic invariance principle for dependent processes. The asymptotic distribution depends on the long run variance of Kendall's tau, for which we propose an estimator and show its consistency. Furthermore, assuming a single change-point, we show that the location of …
This paper is concerned with the limiting spectral behaviors of large dimensional Kendall's rank correlation matrices generated by samples with independent and continuous components. We do not require the components to be identically distributed, and do not need any moment conditions, which is very different from the assumptions imposed in the literature of random matrix theory. The statistical setting in this paper covers a wide range of highly skewed and heavy-tailed distributions. We establish the central limit theorem (CLT) for the linear spectral statistics of the Kendall's rank correlati…
This paper investigates limiting spectral distribution of a high-dimensional Kendall's rank correlation matrix. The underlying population is allowed to have general dependence structure. The result no longer follows the generalized Marucenko-Pastur law, which is brand new. It's the first result on rank correlation matrices with dependence. As applications, we study the Kendall's rank correlation matrix for multivariate normal distributions with a general covariance matrix. From these results, we further gain insights on Kendall's rank correlation matrix and its connections with the sample cova…
Karlsruhe Institute of Technology（卡尔斯鲁厄理工学院）；Heidelberg Institute for Theoretical Studies（海德堡理论研究所）；Goethe University Frankfurt（法兰克福歌德大学）；Helmut-Schmidt-University（赫尔穆特·施密特大学）
A necessary and suffcient condition for Pitman's asymptotic relative effciency (ARE) of the Kendall and Spearman correlation statistics for the independence test to be 1 is given, in terms of certain smoothness and nondegeneracy properties of the model. Corresponding easy to use and broadly applicable sufficient conditions are obtained, which are then illustrated on several known models of dependence. Effects of the presence or absence of the smoothness and/or nondegeneracy parts of the mentioned necessary and suffcient condition are demonstrated using certain specially constructed dependence …
Standard Gini covariance and Gini correlation play important roles in measuring the dependence of random variables with heavy tails. However, the asymmetry brings a substantial difficulty in interpretation. In this paper, we propose a symmetric Gini-type covariance and a symmetric Gini correlation ($ρ_g$) based on the joint rank function. The proposed correlation $ρ_g$ is more robust than the Pearson correlation but less robust than the Kendall's $τ$ correlation. We establish the relationship between $ρ_g$ and the linear correlation $ρ$ for a class of random vectors in the family of elliptical…
We treat the problem of testing independence between m continuous variables when m can be larger than the available sample size n. We consider three types of test statistics that are constructed as sums or sums of squares of pairwise rank correlations. In the asymptotic regime where both m and n tend to infinity, a martingale central limit theorem is applied to show that the null distributions of these statistics converge to Gaussian limits, which are valid with no specific distributional or moment assumptions on the data. Using the framework of U-statistics, our result covers a variety of ran…
Methods are developed for checking and completing systems of bivariate and multivariate Kendall's tau concordance measures in applications where only partial information about dependencies between variables is available. The concept of a concordance signature of a multivariate continuous distribution is introduced; this is the vector of concordance probabilities for margins of all orders. It is shown that every attainable concordance signature is equal to the concordance signature of a unique mixture of the extremal copulas, that is the copulas with extremal correlation matrices consisting exc…
We provide sufficient conditions for the asymptotic normality of the generalized correlation coefficient $\sum a_{ij}b_{ij}$ under the permutation null distribution when $a_{ij}$'s are symmetric and $b_{ij}$'s are symmetric.
We prove that Kendall's Rank correlation matrix converges to the Marčenko-Pastur law, under the assumption that the observations are i.i.d random vectors $X_1$, $\dots$, $X_n$ with components that are independent and absolutely continuous with respect to the Lebesgue measure. This is the first result on the empirical spectral distribution of a multivariate $U$-statistic.
This manuscript develops a general purpose inner-product norm for the Kendall \(τ\) and Spearman's \(ρ\), which operates as an unbiased MLE even in the presence of ties. We derive and prove the strict sub-Gaussianity of the Kemeny norm-space, thereby disproving conclusions developed by both \textcite{kendall1948} and \textcite{diaconis1977} as to the nature of the appropriate, finite sample, probability distribution and test statistics. A non-parametric MLE framework for all bivariate pairs is developed, thereby resolving an hypothesis of \textcite{olkin1994} concerning an exponential multivar…
Is it possible to define a coefficient of correlation which is (a) as simple as the classical coefficients like Pearson's correlation or Spearman's correlation, and yet (b) consistently estimates some simple and interpretable measure of the degree of dependence between the variables, which is 0 if and only if the variables are independent and 1 if and only if one is a measurable function of the other, and (c) has a simple asymptotic theory under the hypothesis of independence, like the classical coefficients? This article answers this question in the affirmative, by producing such a coefficien…
Joint modeling of a large number of variables often requires dimension reduction strategies that lead to structural assumptions of the underlying correlation matrix, such as equal pair-wise correlations within subsets of variables. The underlying correlation matrix is thus of interest for both model specification and model validation. In this paper, we develop tests of the hypothesis that the entries of the Kendall rank correlation matrix are linear combinations of a smaller number of parameters. The asymptotic behavior of the proposed test statistics is investigated both when the dimension is…
For extreme value copulas with a known upper tail dependence coefficient we find pointwise upper and lower bounds, which are used to establish upper and lower bounds of the Spearman and Kendall correlation coefficients. We shown that in all cases the lower bounds are attained on Marshall--Olkin copulas, and the upper ones, on copulas with piecewise linear dependence functions.
We propose a novel class of time-varying nonparanormal graphical models, which allows us to model high dimensional heavy-tailed systems and the evolution of their latent network structures. Under this model, we develop statistical tests for presence of edges both locally at a fixed index value and globally over a range of values. The tests are developed for a high-dimensional regime, are robust to model selection mistakes and do not require commonly assumed minimum signal strength. The testing procedures are based on a high dimensional, debiasing-free moment estimator, which uses a novel kerne…
In this paper, we study the empirical spectral distribution of Spearman's rank correlation matrices, under the assumption that the observations are independent and identically distributed random vectors and the features are correlated. We show that the limiting spectral distribution is the generalized Marucenko-Pastur law with the covariance matrix of the observation after standardized transformation. With these results, we compare several classical covariance/correlation matrices including the sample covariance matrix, Pearson's correlation matrix, Kendall's correlation matrix and Spearman's …
Chatterjee (2021) introduced an asymmetric correlation measure that has attracted much attention over the past year. In this paper, we derive the asymptotic distribution of the symmetric version of Chatterjee's correlation, and suggest a finite sample test for independence.
We propose a new measure related with tail dependence in terms of correlation: quantile correlation coefficient of random variables X, Y. The quantile correlation is defined by the geometric mean of two quantile regression slopes of X on Y and Y on X in the same way that the Pearson correlation is related with the regression coefficients of Y on X and X on Y. The degree of tail dependent association in X, Y, if any, is well reflected in the quantile correlation. The quantile correlation makes it possible to measure sensitivity of a conditional quantile of a random variable with respect to chan…
A prescription is presented for a new and practical correlation coefficient, $ϕ_K$, based on several refinements to Pearson's hypothesis test of independence of two variables. The combined features of $ϕ_K$ form an advantage over existing coefficients. First, it works consistently between categorical, ordinal and interval variables. Second, it captures non-linear dependency. Third, it reverts to the Pearson correlation coefficient in case of a bi-variate normal input distribution. These are useful features when studying the correlation between variables with mixed types. Particular emphasis is…
This paper examines the differences in ordinal rankings obtained from a pairwise comparison matrix using the eigenvalue method and the geometric mean method. First, we introduce several propositions on the (dis)similarity of both rankings concerning the matrix size and its inconsistency expressed by the Koczkodaj's inconsistency index. Further on, we examine the relationship between differences in both rankings and Kendall's rank correlation coefficient $τ$ and Spearman's rank coefficient $ρ$. Apart from theoretical results, intuitive numerical examples and Monte Carlo simulations are also pro…
We compare measures of concordance that arise as Pearson's linear correlation coefficient between two random variables transformed so that they follow the so-called concordance-inducing distributions. The class of such transformed rank correlations includes Spearman's rho, Blomqvist's beta and van der Waerden's coefficient. When only the standard axioms of measures of concordance are required, it is not always clear which transformed rank correlation is most suitable to use. To address this question, we compare measures of concordance in terms of their best and worst asymptotic variances of so…
There has been an increasing interest in testing the equality of large Pearson's correlation matrices. However, in many applications it is more important to test the equality of large rank-based correlation matrices since they are more robust to outliers and nonlinearity. Unlike the Pearson's case, testing the equality of large rank-based statistics has not been well explored and requires us to develop new methods and theory. In this paper, we provide a framework for testing the equality of two large U-statistic based correlation matrices, which include the rank-based correlation matrices as s…
We consider an RCAR$(p)$ process and we establish that the standard estimation lacks consistency as soon as there exists a nonzero serial correlation in the coefficients. We give the correct asymptotic behavior and some simulations come to illustrate the results.
We consider the problem of calculating distance correlation coefficients between random vectors whose joint distributions belong to the class of Lancaster distributions. We derive under mild convergence conditions a general series representation for the distance covariance for these distributions. To illustrate the general theory, we apply the series representation to derive explicit expressions for the distance covariance and distance correlation coefficients for the bivariate normal distribution and its generalizations of Lancaster type, the multivariate normal distributions, and the bivaria…
Pearson's correlation is one of the most common measures of linear dependence. Recently, Bernardo (2015) introduced a flexible class of priors to study this measure in a Bayesian setting. For this large class of priors we show that the (marginal) posterior for Pearson's correlation coefficient and all of the posterior moments are analytic. Our results are available in the open-source software package JASP.
