Spectral goodness-of-fit tests for complete and partial network data
Department of Statistics, University of Washington（华盛顿大学统计学系）；Department of Statistics and Sociology, University of Washington（华盛顿大学统计学与社会学系）；Department of Statistics（统计学系）；Sociology, University of Washington（社会学系）
Networks describe the, often complex, relationships between individual actors. In this work, we address the question of how to determine whether a parametric model, such as a stochastic block model or latent space model, fits a dataset well and will extrapolate to similar data. We use recent results in random matrix theory to derive a general goodness-of-fit test for dyadic data. We show that our method, when applied to a specific model of interest, provides an straightforward, computationally fast way of selecting parameters in a number of commonly used network models. For example, we show how to select the dimension of the latent space in latent space models. Unlike other network goodness-of-fit methods, our general approach does not require simulating from a candidate parametric model, which can be cumbersome with large graphs, and eliminates the need to choose a particular set of statistics on the graph for comparison. It also allows us to perform goodness-of-fit tests on partial network data, such as Aggregated Relational Data. We show with simulations that our method performs well in many situations of interest. We analyze several empirically relevant networks and show that our method leads to improved community detection algorithms. R code to implement our method is available on Github.
A sizable amount of goodness-of-fit tests involving functional data have appeared in the last decade. We provide a relatively compact revision of most of these contributions, within the independent and identically distributed framework, by reviewing goodness-of-fit tests for distribution and regression models with functional predictor and either scalar or functional response.
We propose a goodness-of-fit test for the distribution of errors from a multivariate indirect regression model. The test statistic is based on the Khmaladze transformation of the empirical process of standardized residuals. This goodness-of-fit test is consistent at the root-n rate of convergence, and the test can maintain power against local alternatives converging to the null at a root-n rate.
The Zenga (1984) inequality curve is constant in p for Type I Pareto distributions. This characterizing behavior will be exploited to obtain graphical and analytical tools for tail analysis and goodness of fit tests. A testing procedure for Pareto-type behavior based on a regression of technique will be introduced.
Fitting mixture distributions is needed in applications where data belongs to inhomogeneous populations comprising homogeneous sub-populations. The mixing proportions of the sub populations are in general unknown and need to be estimated as well. A goodness of fit test based on the empirical distribution function is proposed for assessing the goodness of fit in model fits comprising two components, each distributed as two parameter Weibull. The applicability of the proposed test procedure was empirically established using a Monte Carlo simulation study. The proposed test procedure can be easil…
Using fixed point characterization, we develop a new goodness of fit test for uniform distribution. We also discuss how the right censored observations can be incorporated in the proposed test procedure. We study the asymptotic properties of the proposed test statistics. A Monte Carlo simulation is carried out to evaluate the finite sample performance of the tests. We illustrate the test procedures using real data sets.
Goodness-of-fit tests are often used in data analysis to test the agreement of a distribution to a set of data. These tests can be used to detect an unknown signal against a known background or to set limits on a proposed signal distribution in experiments contaminated by poorly understood backgrounds. Out-of-the-box non-parametric tests that can target any proposed distribution are only available in the univariate case. In this paper, we discuss how to build goodness-of-fit tests for arbitrary multivariate distributions or multivariate data generation models.
Non-parametric goodness-of-fit testing procedures based on kernel Stein discrepancies (KSD) are promising approaches to validate general unnormalised distributions in various scenarios. Existing works focused on studying kernel choices to boost test performances. However, the choices of (non-unique) Stein operators also have considerable effect on the test performances. Inspired by the standardisation technique that was originally developed to better derive approximation properties for normal distributions, we present a unifying framework, called standardisation-function kernel Stein discrepan…
This paper studies the goodness of fit test for the bivariate Hermite distribution. Specifically, we propose and study a Cramér-von Mises-type test based on the empirical probability generation function. The bootstrap can be used to consistently estimate the null distribution of the test statistics. A simulation study investigates the goodness of the bootstrap approach for finite sample sizes.
We propose and analyse a novel nonparametric goodness of fit testing procedure for exchangeable exponential random graph models (ERGMs) when a single network realisation is observed. The test determines how likely it is that the observation is generated from a target unnormalised ERGM density. Our test statistics are derived from a kernel Stein discrepancy, a divergence constructed via Steins method using functions in a reproducing kernel Hilbert space, combined with a discrete Stein operator for ERGMs. The test is a Monte Carlo test based on simulated networks from the target ERGM. We show th…
Taking the goodness of fit test (Chi test) as an example, this paper attempts to calculate the Bayesian factor BF10 of n-fold Bernoulli test by the Excel software (using JASP software as the evidence). The results showed that in the range of 0.15-0.55 (the rate of samples which are all "true"), the calculated results of Excel were more accurate, and the differences between the two (Excel and JASP) were not statistically significant (P>0.3).
We consider goodness-of-fit tests for the distribution of the composed error in Stochastic Frontier Models. The proposed test statistic utilizes the characteristic function of the composed error term, and is formulated as a weighted integral of properly standardized data. The new test statistic is shown to be consistent and computationally convenient. Simulation results are presented whereby resampling versions of the new tests are compared to classical goodness-of-fit methods.
We consider multinomial goodness-of-fit tests in the high-dimensional regime where the number of bins increases with the sample size. In this regime, Pearson's chi-squared test can suffer from low power due to the substantial bias as well as high variance of its statistic. To resolve these issues, we introduce a family of U-statistic for multinomial goodness-of-fit and study their asymptotic behaviors in high-dimensions. Specifically, we establish conditions under which the considered U-statistic is asymptotically Poisson or Gaussian, and investigate its power function under each asymptotic re…
Semiparametric clustered overdispersed multinomial goodness-of-fit of log-linear models
传统上，狄利克雷-多项分布被认为是整群抽样方案生成列联表的关键模型。然而，还有其他可能的分布适合这些列联表。本文介绍了新的检验统计量能够测试对数线性建模假设，没有分布规格，当集群的个人可能是均匀相关的。Alonso-Revenga et al.（2016）提出的群内相关系数估计量适用于不同的聚类大小，在拟合优度检验统计量的构建中起着至关重要的作用。
We develop a new goodness fit test for Rayleigh distribution for complete as well as right censored data. We use U-Statistic theory to derive the test statistic. First we develop a test for complete data and then discuss, how right censored observations can be incorporated in the testing procedure. The asymptotic properties of the test statistics in both uncensored and censored cases are studied in detail. Extensive Monte Carlo simulation studies are carried out to validate the performance of the proposed tests. We illustrate the procedures using real data sets. We also provide, a goodness of …
The problem of making practical, useful goodness of fit tests in the Bayesian paradigm is largely open. We introduce a class of special cases (testing for uniformity: have the cards been shuffled enough; does my random generator work) and a class of sensible Bayes tests inspired by Mumford, Wu and Zhu. Calculating these tests presents the challenge of 'doubly intractable distributions'. In present circumstances, modern MCMC techniques are up to the challenge. But many other problems remain. Our paper is didactic, we hope to induce the reader to help take it further.
The coefficient of determination, known as $R^2$, is commonly used as a goodness-of-fit criterion for fitting linear models. $R^2$ is somewhat controversial when fitting nonlinear models, although it may be generalised on a case-by-case basis to deal with specific models such as the logistic model. Assume we are fitting a parametric distribution to a data set using, say, the maximum likelihood estimation method. A general approach to measure the goodness-of-fit of the fitted parameters, which is advocated herein, is to use a nonparametric measure for comparison between the empirical distributi…
In the present paper, we develop a new goodness fit test for gamma distribution using the fixed point characterization. U-Statistic theory is employed to derive the test statistic. We discuss how the right censored observations are incorporated in the test developed here. The asymptotic properties of the test statistic in both censored and uncensored cases are studied in detail. Extensive Monte Carlo simulation studies are carried out to validate the performance of the proposed tests. We also illustrate the test procedure using several real data sets.
In many applications, we encounter data on Riemannian manifolds such as torus and rotation groups. Standard statistical procedures for multivariate data are not applicable to such data. In this study, we develop goodness-of-fit testing and interpretable model criticism methods for general distributions on Riemannian manifolds, including those with an intractable normalization constant. The proposed methods are based on extensions of kernel Stein discrepancy, which are derived from Stein operators on Riemannian manifolds. We discuss the connections between the proposed tests with existing ones …
In many fields, data appears in the form of direction (unit vector) and usual statistical procedures are not applicable to such directional data. In this study, we propose non-parametric goodness-of-fit testing procedures for general directional distributions based on kernel Stein discrepancy. Our method is based on Stein's operator on spheres, which is derived by using Stokes' theorem. Notably, the proposed method is applicable to distributions with an intractable normalization constant, which commonly appear in directional statistics. Experimental results demonstrate that the proposed method…
