We introduce new estimates and tests of independence in copula models with unknown margins using $ϕ$-divergences and the duality technique. The asymptotic laws of the estimates and the test statistics are established both when the parameter is an interior or a boundary value of the parameter space. Simulation results show that the choice of $χ^2$-divergence has good properties in terms of efficiency-robustness.
We introduce a new test procedure of independence in the framework of parametric copulas with unknown marginals. The method is based essentially on the dual representation of $χ^2$-divergence on signed finite measures. The asymptotic properties of the proposed estimate and the test statistic are studied under the null and alternative hypotheses, with simple and standard limit distributions both when the parameter is an interior point or not.
We propose a new method to test conditional independence of two real random variables $Y$ and $Z$ conditionally on an arbitrary third random variable $X$. %with $F_{.|.}$ representing conditional distribution functions, The partial copula is introduced, defined as the joint distribution of $U=F_{Y|X}(Y|X)$ and $V=F_{Z|X}(Z|X)$. We call this transformation of $(Y,Z)$ into $(U,V)$ the partial copula transform. It is easy to show that if $Y$ and $Z$ are continuous for any given value of $X$, then $Y\ind Z|X$ implies $U\ind V$. Conditional independence can then be tested by (i) applying the partia…
The partial copula provides a method for describing the dependence between two random variables $X$ and $Y$ conditional on a third random vector $Z$ in terms of nonparametric residuals $U_1$ and $U_2$. This paper develops a nonparametric test for conditional independence by combining the partial copula with a quantile regression based method for estimating the nonparametric residuals. We consider a test statistic based on generalized correlation between $U_1$ and $U_2$ and derive its large sample properties under consistency assumptions on the quantile regression procedure. We demonstrate thro…
Over the last couple of decades, several copula based methods have been proposed in the literature to test for the independence among several random variables. But these existing tests are not invariant under monotone transformations of the variables, and they often perform poorly if the dependence among the variables is highly non-monotone in nature. In this article, we propose a copula based measure of dependency and use it to construct some new distribution-free tests of independence. The proposed measure and the resulting tests, all are invariant under permutations and monotone transformat…
Copulas are mathematical objects that fully capture the dependence structure among random variables and hence, offer a great flexibility in building multivariate stochastic models. In statistics, a copula is used as a general way of formulating a multivariate distribution in such a way that various general types of dependence can be represented. In case of bivariate sample, the notion of estimating copula is closely related to that of testing independence in a bivariate sample, as when the components of the bivariate sample are independent the copula becomes simply product of two uniform distr…
We propose a class of flexible non-parametric tests for the presence of dependence between components of a random vector based on weighted Cramér-von Mises functionals of the empirical copula process. The weights act as a tuning parameter and are shown to significantly influence the power of the test, making it more sensitive to different types of dependence. Asymptotic properties of the test are stated in the general case, for an arbitrary bounded and integrable weighting function, and computational formulas for a number of weighted statistics are provided. Several issues relating to the choi…
A new index based on empirical copulas, termed the Copula Statistic (CoS), is introduced for assessing the strength of multivariate dependence and for testing statistical independence. New properties of the copulas are proved. They allow us to define the CoS in terms of a relative distance function between the empirical copula, the Fréchet-Hoeffding bounds and the independence copula. Monte Carlo simulations reveal that for large sample sizes, the CoS is approximately normal. This property is utilised to develop a CoS-based statistical test of independence against various noisy functional depe…
The purpose of this paper is twofold. First, we provide a novel characterization of independence of random vectors based on the checkerboard approximation to a multivariate copula. Using this result, we then propose a new family of tests of multivariate independence for continuous random vectors. The tests rely on estimating the checkerboard approximation by means of the sample copula recently introduced in [9] and improved in [11]. Such estimators have nice properties, including a Glivenko-Cantelli-type theorem that guarantees almost-sure uniform convergence to the checkerboard approximation.…
Benford's law describes a common phenomenon among many naturally occurring data sets and distributions in which the leading digits of the data are distributed with the probability of a first digit of $d$ base $B$ being $\log_{B}{\frac{d+1}{d}}$. As it often successfully detects fraud in medical trials, voting, science and finance, significant effort has been made to understand when and how distributions exhibit Benford behavior. Most of the previous work has been restricted to cases of independent variables, and little is known about situations involving dependence. We use copulas to investiga…
The PC algorithm uses conditional independence tests for model selection in graphical modeling with acyclic directed graphs. In Gaussian models, tests of conditional independence are typically based on Pearson correlations, and high-dimensional consistency results have been obtained for the PC algorithm in this setting. We prove that high-dimensional consistency carries over to the broader class of Gaussian copula or \textit{nonparanormal} models when using rank-based measures of correlation. For graphs with bounded degree, our result is as strong as prior Gaussian results. In simulations, the…
How far are $d$-dimensional copulas with uniform $(d-1)$-marginals from (total) independence?
University of Ljubljana, School of Economics and Business(卢布尔雅那大学经济与企业学院);Institute of Mathematics, Physics and Mechanics(数学、物理与力学研究所);University of Ljubljana, Faculty of Civil and Geodetic Engineering(卢布尔雅那大学土木与测量工程学院);University of Ljubljana, Faculty of Mathematics and Physics(卢布尔雅那大学数学与物理学院)
Building higher-dimensional copulas is generally recognized as a difficult problem. Regular-vines using bivariate copulas provide a flexible class of high-dimensional dependency models. In large dimensions, the drawback of the model is the exponentially increasing complexity. Recognizing some of the conditional independences is a possibility for reducing the number of levels of the pair-copula decomposition, and hence to simplify its construction Aas et al (2009). The idea of using conditional independences was already performed under elliptical copula assumptions Hanea, Kurowicka and Cooke (2…
We propose a new multivariate dependency measure. It is obtained by considering a Gaussian kernel based distance between the copula transform of the given d-dimensional distribution and the uniform copula and then appropriately normalizing it. The resulting measure is shown to satisfy a number of desirable properties. A nonparametric estimate is proposed for this dependency measure and its properties (finite sample as well as asymptotic) are derived. Some comparative studies of the proposed dependency measure estimate with some widely used dependency measure estimates on artificial datasets ar…
Deheuvels [J. Multivariate Anal. 11 (1981) 102--113] and Genest and Rémillard [Test 13 (2004) 335--369] have shown that powerful rank tests of multivariate independence can be based on combinations of asymptotically independent Cramér--von Mises statistics derived from a Möbius decomposition of the empirical copula process. A result on the large-sample behavior of this process under contiguous sequences of alternatives is used here to give a representation of the limiting distribution of such test statistics and to compute their relative local asymptotic efficiency. Local power curves and asym…
We present a joint copula-based model for insurance claims and sizes. It uses bivariate copulae to accommodate for the dependence between these quantities. We derive the general distribution of the policy loss without the restrictive assumption of independence. We illustrate that this distribution tends to be skewed and multi-modal, and that an independence assumption can lead to substantial bias in the estimation of the policy loss. Further, we extend our framework to regression models by combining marginal generalized linear models with a copula. We show that this approach leads to a flexibl…
An Archimedean copula is characterised by its generator. This is a real function whose inverse behaves as a survival function. We propose a semiparametric generator based on a quadratic spline. This is achieved by modelling the first derivative of a hazard rate function, in a survival analysis context, as a piecewise constant function. Convexity of our semiparametric generator is obtained by imposing some simple constraints. The induced semiparametric Archimedean copula produces Kendall's tau association measure that covers the whole range $(-1,1)$. Inference on the model is done under a Bayes…
Copulas have been popular to model dependence for multivariate distributions, but have not been used much in modelling temporal dependence of univariate time series. This paper demonstrates some difficulties with using copulas even for Markov processes: some tractable copulas such as mixtures between copulas of complete co- and countermonotonicity and independence (Fréchet copulas) are shown to imply quite a restricted type of Markov process and Archimedean copulas are shown to be incompatible with Markov chains. We also investigate Markov chains that are spreadable or, equivalently, condition…
We propose a new goodness-of-fit test for copulas, based on empirical copula processes and their nonparametric bootstrap counterparts. The standard Kolmogorov-Smirnov type test for copulas that takes the supremum of the empirical copula process indexed by half spaces is extended by test statistics based on the supremum of the empirical copula process indexed by partitions of Ln rectangles with Ln slowly tending to infinity. Although the underlying empirical process does not converge, it is proved that the p-values of our new test statistic can be consistently estimated by the bootstrap. Simula…
The multivariate Hilbert-Schmidt-Independence-Criterion (dHSIC) and distance multivariance allow to measure and test independence of an arbitrary number of random vectors with arbitrary dimensions. Here we define versions which only depend on an underlying copula. The approach is based on the distributional transform, yielding dependence measures which always feature a natural invariance with respect to scalings and translations. Moreover, it requires no distributional assumptions, i.e., the distributions can be of pure type or any mixture of discrete and continuous distributions and (in our s…
Two goodness-of-fit tests for copulas are being investigated. The first one deals with the case of elliptical copulas and the second one deals with independent copulas. These tests result from the expansion of the projection pursuit methodology we will introduce in the present article. This method enables us to determine on which axis system these copulas lie as well as the exact value of these very copulas in the basis formed by the axes previously determined irrespective of their value in their canonical basis. Simulations are also presented as well as an application to real datasets.
We propose a new test for the hypothesis that a bivariate copula is an Archimedean copula. The test statistic is based on a combination of two measures resulting from the characterization of Archimedean copulas by the property of associativity and by a strict upper bound on the diagonal by the Fréchet-upper bound. We prove weak convergence of this statistic and show that the critical values of the corresponding test can be determined by the multiplier bootstrap method. The test is shown to be consistent against all departures from Archimedeanity if the copula satisfies weak smoothness assumpti…
Considering multivariate strongly mixing time series, nonparametric tests for a constant copula with specified or unspecified change point (candidate) are derived; the tests are consistent against general alternatives. A tapered block multiplier technique based on serially dependent multiplier random variables is provided to estimate p-values of the test statistics. Size and power of the tests in finite samples are evaluated with Monte Carlo simulations. The block multiplier technique might have several other applications for statistical inference on copulas of serially dependent data.
We discuss the so-called "simplifying assumption" of conditional copulas in a general framework. We introduce several tests of the latter assumption for non- and semiparametric copula models. Some related test procedures based on conditioning subsets instead of point-wise events are proposed. The limiting distribution of such test statistics under the null are approximated by several bootstrap schemes, most of them being new. We prove the validity of a particular semiparametric bootstrap scheme. Some simulations illustrate the relevance of our results.
Consider a random sample from a continuous multivariate distribution function $F$ with copula $C$. In order to test the null hypothesis that $C$ belongs to a certain parametric family, we construct an empirical process on the unit hypercube that converges weakly to a standard Wiener process under the null hypothesis. This process can therefore serve as a `tests generator' for asymptotically distribution-free goodness-of-fit testing of copula families. We also prove maximal sensitivity of this process to contiguous alternatives. Finally, we demonstrate through a Monte Carlo simulation study tha…
We consider the problem of testing hypotheses on the copula density from $n$ bi-dimensional observations. We wish to test the null hypothesis characterized by a parametric class against a composite nonparametric alternative. Each density under the alternative is separated in the $L_2$-norm from any density lying in the null hypothesis. The copula densities under consideration are supposed to belong to a range of Besov balls. According to the minimax approach, the testing problem is solved in an adaptive framework: it leads to a $\log\log$ term loss in the minimax rate of testing in comparison …
We derive independence tests by means of dependence measures thresholding in a semiparametric context. Precisely, estimates of phi-mutual informations, associated to phi-divergences between a joint distribution and the product distribution of its margins, are derived through the dual representation of phi-divergences. The asymptotic properties of the proposed estimates are established, including consistency, asymptotic distributions and large deviations principle. The obtained tests of independence are compared via their relative asymptotic Bahadur efficiency and numerical simulations. It foll…
We introduce a new goodness-of-fit test for regular vine (R-vine) copula models. R-vine copulas are a very flexible class of multivariate copulas based on a pair-copula construction (PCC). The test arises from the information matrix equality and specification test proposed by White (1982) and extends the goodness-of-fit test for copulas introduced by Huang and Prokhorov (2011). The corresponding critical value can be approximated by asymptotic theory or simulation. The simulation based test shows excellent performance with regard to observed size and power in an extensive simulation study, whi…
A multivariate distribution function F is in the max-domain of attraction of an extreme value distribution if and only if this is true for the copula corresponding to F and its univariate margins. Aulbach et al. (2012a) have shown that a copula satisfies the extreme value condition if and only if the copula is tail equivalent to a generalized Pareto copula (GPC). In this paper we propose a chi-square goodness-of-fit test in arbitrary dimension for testing whether a copula is in a certain neighborhood of a GPC. The test can be applied to stochastic processes as well to check whether the corresp…
We are considered with the false discovery rate (FDR) of the linear step-up test $φ^{LSU}$ considered by Benjamini and Hochberg (1995). It is well known that $φ^{LSU}$ controls the FDR at level $m_0 q / m$ if the joint distribution of $p$-values is multivariate totally positive of order 2. In this, $m$ denotes the total number of hypotheses, $m_0$ the number of true null hypotheses, and $q$ the nominal FDR level. Under the assumption of an Archimedean $p$-value copula with completely monotone generator, we derive a sharper upper bound for the FDR of $φ^{LSU}$ as well as a non-trivial lower bou…
Consider $n$ i.i.d. random vectors on $\mathbb{R}^2$, with unknown, common distribution function $F$. Under a sharpening of the extreme value condition on $F$, we derive a weighted approximation of the corresponding tail copula process. Then we construct a test to check whether the extreme value condition holds by comparing two estimators of the limiting extreme value distribution, one obtained from the tail copula process and the other obtained by first estimating the spectral measure which is then used as a building block for the limiting extreme value distribution. We derive the limiting di…
Within a high-frequency framework, we propose a non-parametric approach to estimate a family of copulas associated to a time-changed Brownian motion. We show that our estimator is consistent and asymptotically mixed-Gaussian. Furthermore, we test its finite-sample accuracy via Monte Carlo.
Let $(X_1,Y_1),\ldots,(X_n,Y_n)$ be an i.i.d. sample from a bivariate distribution function that lies in the max-domain of attraction of an extreme value distribution. The asymptotic joint distribution of the standardized component-wise maxima $\bigvee_{i=1}^nX_i$ and $\bigvee_{i=1}^nY_i$ is then characterized by the marginal extreme value indices and the tail copula $R$. We propose a procedure for constructing asymptotically distribution-free goodness-of-fit tests for the tail copula $R$. The procedure is based on a transformation of a suitable empirical process derived from a semi-parametric…
It is often reasonable to assume that the dependence structure of a bivariate continuous distribution belongs to the class of extreme-value copulas. The latter are characterized by their Pickands dependence function. In this paper, a procedure is proposed for testing whether this function belongs to a given parametric family. The test is based on a Cramér--von Mises statistic measuring the distance between an estimate of the parametric Pickands dependence function and either one of two nonparametric estimators thereof studied by Genest and Segers [Ann. Statist. 37 (2009) 2990--3022]. As the li…
The empirical beta copula is a simple but effective smoother of the empirical copula. Because it is a genuine copula, from which, moreover, it is particularly easy to sample, it is reasonable to expect that resampling procedures based on the empirical beta copula are expedient and accurate. In this paper, after reviewing the literature on some bootstrap approximations for the empirical copula process, we first show the asymptotic equivalence of several bootstrapped processes related to the empirical copula and empirical beta copula. Then we investigate the finite-sample properties of resamplin…
Testing mutual independence for high-dimensional observations is a fundamental statistical challenge. Popular tests based on linear and simple rank correlations are known to be incapable of detecting non-linear, non-monotone relationships, calling for methods that can account for such dependences. To address this challenge, we propose a family of tests that are constructed using maxima of pairwise rank correlations that permit consistent assessment of pairwise independence. Built upon a newly developed Cramér-type moderate deviation theorem for degenerate U-statistics, our results cover a vari…
Several procedures have been recently proposed to test the simplifying assumption for conditional copulas. Instead of considering pointwise conditioning events, we study the constancy of the conditional dependence structure when some covariates belong to general borelian conditioning subsets. Several test statistics based on the equality of conditional Kendall's tau are introduced, and we derive their asymptotic distributions under the null. When such conditioning events are not fixed ex ante, we propose a data-driven procedure to recursively build such relevant subsets. It is based on decisio…