The chi square goodness-of-fit test is among the oldest known statistical tests, first proposed by Pearson in 1900 for the multinomial distribution. It has been in use in many fields ever since. However, various studies have shown that when applied to data from a continuous distribution it is generally inferior to other methods such as the Kolmogorov-Smirnov or Anderson-Darling tests. However, the performance, that is the power, of the chi square test depends crucially on the way the data is binned. In this paper we describe a method that automatically finds a binning that is very good against a specific alternative. We show that then the chi square test is generally competitive and sometimes even superior to other standard tests.
We suggest several goodness-of-fit methods which are appropriate with Type-II right censored data. Our strategy is to transform the original observations from a censored sample into an approximately i.i.d. sample of normal variates and then perform a standard goodness-of-fit test for normality on the transformed observations. A simulation study with several well known parametric distributions under testing reveals the sampling properties of the methods. We also provide theoretical analysis of the proposed method.
The process comparing the empirical cumulative distribution function of the sample with a parametric estimate of the cumulative distribution function is known as the empirical process with estimated parameters and has been extensively employed in the literature for goodness-of-fit testing. The simplest way to carry out such goodness-of-fit tests, especially in a multivariate setting, is to use a parametric bootstrap. Although very easy to implement, the parametric bootstrap can become very computationally expensive as the sample size, the number of parameters, or the dimension of the data incr…
An empirical power comparison is made between two tests based on the empirical characteristic function and some of the best performing tests for normality. A simple normality test based on the empirical characteristic function calculated in a single point is shown to outperform the more complicated Epps-Pulley test and the frequentist tests included in the study in large samples.
A sizable amount of goodness-of-fit tests involving functional data have appeared in the last decade. We provide a relatively compact revision of most of these contributions, within the independent and identically distributed framework, by reviewing goodness-of-fit tests for distribution and regression models with functional predictor and either scalar or functional response.
We propose a goodness-of-fit test for the distribution of errors from a multivariate indirect regression model. The test statistic is based on the Khmaladze transformation of the empirical process of standardized residuals. This goodness-of-fit test is consistent at the root-n rate of convergence, and the test can maintain power against local alternatives converging to the null at a root-n rate.
This article deals with goodness-of-fit test for the Cauchy distribution. Some tests based on Kullback-Leibler information are proposed, and shown to be consistent. Monte Carlo evidence indicates that the tests have satisfactory performances against symmetric alternatives. An empirical application to quantitative finance is provided.
The Zenga (1984) inequality curve is constant in p for Type I Pareto distributions. This characterizing behavior will be exploited to obtain graphical and analytical tools for tail analysis and goodness of fit tests. A testing procedure for Pareto-type behavior based on a regression of technique will be introduced.
Fitting mixture distributions is needed in applications where data belongs to inhomogeneous populations comprising homogeneous sub-populations. The mixing proportions of the sub populations are in general unknown and need to be estimated as well. A goodness of fit test based on the empirical distribution function is proposed for assessing the goodness of fit in model fits comprising two components, each distributed as two parameter Weibull. The applicability of the proposed test procedure was empirically established using a Monte Carlo simulation study. The proposed test procedure can be easil…
We introduce a new goodness-of-fit test for regular vine (R-vine) copula models, a flexible class of multivariate copulas based on a pair-copula construction (PCC). The test arises from the information matrix ratio. The corresponding test statistic is derived and its asymptotic normality is proven. The test's power is investigated and compared to 14 other goodness-of-fit tests, adapted from the bivariate copula case, in a high dimensional setting. The extensive simulation study shows the excellent performance with respect to size and power as well as the superiority of the information matrix r…
Using fixed point characterization, we develop a new goodness of fit test for uniform distribution. We also discuss how the right censored observations can be incorporated in the proposed test procedure. We study the asymptotic properties of the proposed test statistics. A Monte Carlo simulation is carried out to evaluate the finite sample performance of the tests. We illustrate the test procedures using real data sets.
Social networks and other large sparse data sets pose significant challenges for statistical inference, as many standard statistical methods for testing model fit are not applicable in such settings. Algebraic statistics offers a theoretically justified approach to goodness-of-fit testing that relies on the theory of Markov bases and is intimately connected with the geometry of the model as described by its fibers. Most current practices require the computation of the entire basis, which is infeasible in many practical settings. We present a dynamic approach to explore the fiber of a model, wh…
Traditionally, the Dirichlet-multinomial distribution has been recognized as a key model for contingency tables generated by cluster sampling schemes. There are, however, other possible distributions appropriate for these contingency tables. This paper introduces new test-statistics capable to test log-linear modeling hypotheses with no distributional specification, when the individuals of the clusters are possibly homogeneously correlated. The estimator for the intracluster correlation coefficient proposed in Alonso-Revenga et al. (2016), valid for different cluster sizes, plays a crucial rol…
The problem of making practical, useful goodness of fit tests in the Bayesian paradigm is largely open. We introduce a class of special cases (testing for uniformity: have the cards been shuffled enough; does my random generator work) and a class of sensible Bayes tests inspired by Mumford, Wu and Zhu. Calculating these tests presents the challenge of 'doubly intractable distributions'. In present circumstances, modern MCMC techniques are up to the challenge. But many other problems remain. Our paper is didactic, we hope to induce the reader to help take it further.
Box-Cox power transformation is a commonly used methodology to transform the distribution of a non-normal data into a normal one. Estimation of the transformation parameter is crucial in this methodology. In this study, the estimation process is hold via a searching algorithm and is integrated into well-known seven goodness of fit tests for normal distribution. An artificial covariate method is also included for comparative purposes. Simulation studies are implemented to compare the effectiveness of the proposed methods. The methods are also illustrated on two different real life data applicat…
In the present paper, we develop a new goodness fit test for gamma distribution using the fixed point characterization. U-Statistic theory is employed to derive the test statistic. We discuss how the right censored observations are incorporated in the test developed here. The asymptotic properties of the test statistic in both censored and uncensored cases are studied in detail. Extensive Monte Carlo simulation studies are carried out to validate the performance of the proposed tests. We also illustrate the test procedure using several real data sets.
In many applications, we encounter data on Riemannian manifolds such as torus and rotation groups. Standard statistical procedures for multivariate data are not applicable to such data. In this study, we develop goodness-of-fit testing and interpretable model criticism methods for general distributions on Riemannian manifolds, including those with an intractable normalization constant. The proposed methods are based on extensions of kernel Stein discrepancy, which are derived from Stein operators on Riemannian manifolds. We discuss the connections between the proposed tests with existing ones …
In many fields, data appears in the form of direction (unit vector) and usual statistical procedures are not applicable to such directional data. In this study, we propose non-parametric goodness-of-fit testing procedures for general directional distributions based on kernel Stein discrepancy. Our method is based on Stein's operator on spheres, which is derived by using Stokes' theorem. Notably, the proposed method is applicable to distributions with an intractable normalization constant, which commonly appear in directional statistics. Experimental results demonstrate that the proposed method…
We propose a class of goodness-of-fit tests for complete spatial randomness (CSR). In contrast to standard tests, our procedure utilizes a transformation of the data to a binary image, which is then characterized by geometric functionals. Under a suitable limiting regime, we derive the asymptotic distribution of the test statistics under the null hypothesis and almost sure limits under certain alternatives. The new tests are computationally efficient, and simulations show that they are strong competitors to other tests of CSR. The tests are applied to a real data set in gamma-ray astronomy, an…
A self-contained Fortran-77 program for goodness of fit tests for histograms with weighted entries as well as with unweighted entries is presented. The code calculates test statistics for case of histogram with normalized weights of events and in case of unnormalized weights of events.
We review the main "omnibus procedures" for goodness-of-fit testing for copulas: tests based on the empirical copula process, on probability integral transformations, on Kendall's dependence function, etc, and some corresponding reductions of dimension techniques. The problems of finding asymptotic distribution-free test statistics and the calculation of reliable p-values are discussed. Some particular cases, like convenient tests for time-dependent copulas, for Archimedean or extreme-value copulas, etc, are dealt with. Finally, the practical performances of the proposed approaches are briefly…
We present a unified approach to goodness-of-fit testing in $\mathbb{R}^d$ and on lower-dimensional manifolds embedded in $\mathbb{R}^d$ based on sums of powers of weighted volumes of $k$-th nearest neighbor spheres. We prove asymptotic normality of a class of test statistics under the null hypothesis and under fixed alternatives. Under such alternatives, scaled versions of the test statistics converge to the $α$-entropy between probability distributions. A simulation study shows that the procedures are serious competitors to established goodness-of-fit tests.
Functional linear models are one of the most fundamental tools to assess the relation between two random variables of a functional or scalar nature. This contribution proposes a goodness-of-fit test for the functional linear model with functional response that neatly adapts to functional/scalar responses/predictors. In particular, the new goodness-of-fit test extends a previous proposal for scalar response. The test statistic is based on a convenient regularized estimator, is easy to compute, and is calibrated through an efficient bootstrap resampling. A graphical diagnostic tool, useful to vi…
In this work, a goodness-of-fit test for the null hypothesis of a functional linear model with scalar response is proposed. The test is based on a generalization to the functional framework of a previous one, designed for the goodness-of-fit of regression models with multivariate covariates using random projections. The test statistic is easy to compute using geometrical and matrix arguments, and simple to calibrate in its distribution by a wild bootstrap on the residuals. The finite sample properties of the test are illustrated by a simulation study for several types of basis and under differ…
Goodness-of-fit tests are often used in data analysis to test the agreement of a distribution to a set of data. These tests can be used to detect an unknown signal against a known background or to set limits on a proposed signal distribution in experiments contaminated by poorly understood backgrounds. Out-of-the-box non-parametric tests that can target any proposed distribution are only available in the univariate case. In this paper, we discuss how to build goodness-of-fit tests for arbitrary multivariate distributions or multivariate data generation models.
We consider the goodness of fit testing problem for stochastic differential equation with small diffiusion coefficient. The basic hypothesis is always simple and it is described by the known trend coefficient. We propose several tests of the type of Cramer-von Mises, Kolmogorov-Smirnov and Chi-Square. The power functions of these tests we study for a special classes of close alternatives. We discuss the construction of the goodness of fit test based on the local time and the possibility of the construction of asymptotically distribution free tests in the case of composite basic hypothesis.
This paper contributes to answering a question that is of crucial importance in risk management and extreme value theory: How to select the threshold above which one assumes that the tail of a distribution follows a generalized Pareto distribution. This question has gained increasing attention, particularly in finance institutions, as the recent regulative norms require the assessment of risk at high quantiles. Recent methods answer this question by multiple uses of the standard goodness-of-fit tests. These tests are based on a particular choice of symmetric weighting of the mean square error …
Pearson's chi-squared test is widely used to test the goodness of fit between categorical data and a given discrete distribution function. When the number of sets of the categorical data, say $k$, is a fixed integer, Pearson's chi-squared test statistic converges in distribution to a chi-squared distribution with $k-1$ degrees of freedom when the sample size $n$ goes to infinity. In real applications, the number $k$ often changes with $n$ and may be even much larger than $n$. By using the martingale techniques, we prove that Pearson's chi-squared test statistic converges to the normal under qu…
The normal distribution has the unique property that the cumulant generating function has only two terms, namely those involving the mean and the variance. This property is used to construct a simple by using the log of the modulus of the empirical characteristic function to what would be expected under normality. The test statistic is easy to calculate. Using a simulation study the proposed test is shown to have excellent power, especially in large samples.
Unbinned maximum likelihood is a common procedure for parameter estimation. After parameters have been estimated, it is crucial to know whether the fit model adequately describes the experimental data. Univariate Goodness of Fit procedures have been thoroughly analyzed. In multi-dimensions, Goodness of Fit test powers have rarely been studied on realistic problems. There is no definitive answer to regarding which method is better. Test performance is strictly related to specific analysis characteristics. In this work, a review of multi-variate Goodness of Fit techniques is presented.
The Ising model is one of the simplest and most famous models of interacting systems. It was originally proposed to model ferromagnetic interactions in statistical physics and is now widely used to model spatial processes in many areas such as ecology, sociology, and genetics, usually without testing its goodness of fit. Here, we propose various test statistics and an exact goodness-of-fit test for the finite-lattice Ising model. The theory of Markov bases has been developed in algebraic statistics for exact goodness-of-fit testing using a Monte Carlo approach. However, finding a Markov basis …
We consider multinomial goodness-of-fit tests in the high-dimensional regime where the number of bins increases with the sample size. In this regime, Pearson's chi-squared test can suffer from low power due to the substantial bias as well as high variance of its statistic. To resolve these issues, we introduce a family of U-statistic for multinomial goodness-of-fit and study their asymptotic behaviors in high-dimensions. Specifically, we establish conditions under which the considered U-statistic is asymptotically Poisson or Gaussian, and investigate its power function under each asymptotic re…
We construct integral and supremum type goodness-of-fit tests for the family of power distribution functions. Test statistics are functionals of $U-$empirical processes and are based on the classical characterization of power function distribution family belonging to Puri and Rubin. We describe the logarithmic large deviation asymptotics of test statistics under null-hypothesis, and calculate their local Bahadur efficiency under common parametric alternatives. Conditions of local optimality of new statistics are given.
We develop a new goodness fit test for Rayleigh distribution for complete as well as right censored data. We use U-Statistic theory to derive the test statistic. First we develop a test for complete data and then discuss, how right censored observations can be incorporated in the testing procedure. The asymptotic properties of the test statistics in both uncensored and censored cases are studied in detail. Extensive Monte Carlo simulation studies are carried out to validate the performance of the proposed tests. We illustrate the procedures using real data sets. We also provide, a goodness of …
We employ a general Monte Carlo method to test composite hypotheses of goodness-of-fit for several popular multivariate models that can accommodate both asymmetry and heavy tails. Specifically, we consider weighted L2-type tests based on a discrepancy measure involving the distance between empirical characteristic functions and thus avoid the need for employing corresponding population quantities which may be unknown or complicated to work with. The only requirements of our tests are that we should be able to draw samples from the distribution under test and possess a reasonable method of esti…
Testing procedures for assessing a parametric regression model with circular response and $\mathbb{R}^d$-valued covariate are proposed and analyzed in this work both for independent and for spatially correlated data. The test statistics are based on a circular distance comparing a (non-smoothed or smoothed) parametric circular estimator and a nonparametric one. Properly designed bootstrap procedures for calibrating the tests in practice are also presented. Finite sample performance of the tests in different scenarios with independent and spatially correlated samples, is analyzed by simulations…
The coefficient of determination, known as $R^2$, is commonly used as a goodness-of-fit criterion for fitting linear models. $R^2$ is somewhat controversial when fitting nonlinear models, although it may be generalised on a case-by-case basis to deal with specific models such as the logistic model. Assume we are fitting a parametric distribution to a data set using, say, the maximum likelihood estimation method. A general approach to measure the goodness-of-fit of the fitted parameters, which is advocated herein, is to use a nonparametric measure for comparison between the empirical distributi…
This paper studies the goodness of fit test for the bivariate Hermite distribution. Specifically, we propose and study a Cramér-von Mises-type test based on the empirical probability generation function. The bootstrap can be used to consistently estimate the null distribution of the test statistics. A simulation study investigates the goodness of the bootstrap approach for finite sample sizes.
The efficiency of distribution-free {\it integrated} goodness-of-fit tests was studied by Henze and Nikitin (2000, 2002) under location alternatives. We calculate local Bahadur efficiencies of these tests under more realistic generalized skew alternatives. They turn out to be unexpectedly high.
In quantitative finance, we often fit a parametric semimartingale model to asset prices. To ensure our model is correct, we must then perform goodness-of-fit tests. In this paper, we give a new goodness-of-fit test for volatility-like processes, which is easily applied to a variety of semimartingale models. In each case, we reduce the problem to the detection of a semimartingale observed under noise. In this setting, we then describe a wavelet-thresholding test, which obtains adaptive and near-optimal detection rates.
We consider the goodness of fit testing problem for ergodic diffusion processes. The basic hypothesis is supposed to be simple. The diffusion coefficient is known and the alternatives are described by the different trend coefficients. We study the asymptotic distribution of the Cramer-von Mises type tests based on the empirical distribution function and local time estimator of the invariant density. At particularly, we propose a transformation which makes these tests asymptotically distribution free. We discuss the modifications of this test in the case of composite basic hypothesis.
