首页/论文/2008.05974

arXiv 2008.059742020-08-13math.STstat.TH

On the Phase Transition of Wilk's Phenomenon

Yinqiu He, Bo Meng, Zhenghao Zeng, Gongjun Xu

英文摘要：

Wilk's theorem, which offers universal chi-squared approximations for likelihood ratio tests, is widely used in many scientific hypothesis testing problems. For modern datasets with increasing dimension, researchers have found that the conventional Wilk's phenomenon of the likelihood ratio test statistic often fails. Although new approximations have been proposed in high dimensional settings, there still lacks a clear statistical guideline regarding how to choose between the conventional and newly proposed approximations, especially for moderate-dimensional data. To address this issue, we develop the necessary and sufficient phase transition conditions for Wilk's phenomenon under popular tests on multivariate mean and covariance structures. Moreover, we provide an in-depth analysis of the accuracy of chi-squared approximations by deriving their asymptotic biases. These results may provide helpful insights into the use of chi-squared approximations in scientific practices.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

Wilks' theorems in the $β$-model

Likelihood ratio tests and the Wilks theorems have been pivotal in statistics but have rarely been explored in network models with an increasing dimension. We are concerned here with likelihood ratio tests in the $β$-model for undirected graphs. For two growing dimensional null hypotheses including a specified null $H_0: β_i=β_i^0$ for $i=1,\ldots, r$ and a homogenous null $H_0: β_1=\cdots=β_r$, we reveal high dimensional Wilks' phenomena that the normalized log-likelihood ratio statistic, $[2\{\ell(\widehat{\boldsymbolβ}) - \ell(\widehat{\boldsymbolβ}^0)\} - r]/(2r)^{1/2}$, converges in distr…

2022-11-18math.STstat.MEstat.TH

Nonparametric inference for additive models estimated via simplified smooth backfitting

We investigate hypothesis testing in nonparametric additive models estimated using simplified smooth backfitting (Huang and Yu, Journal of Computational and Graphical Statistics, \textbf{28(2)}, 386--400, 2019). Simplified smooth backfitting achieves oracle properties under regularity conditions and provides closed-form expressions of the estimators that are useful for deriving asymptotic properties. We develop a generalized likelihood ratio (GLR) and a loss function (LF) based testing framework for inference. Under the null hypothesis, both the GLR and LF tests have asymptotically rescaled ch…

2022-09-15math.STstat.MEstat.TH

Penalized maximum likelihood estimation and effective dimension

This paper extends some prominent statistical results including \emph{Fisher Theorem and Wilks phenomenon} to the penalized maximum likelihood estimation with a quadratic penalization. It appears that sharp expansions for the penalized MLE $\tilde{\thetav}_{G} $ and for the penalized maximum likelihood can be obtained without involving any asymptotic arguments, the results only rely on smoothness and regularity properties of the of the considered log-likelihood function. The error of estimation is specified in terms of the effective dimension $p_G $ of the parameter set which can be much s…

2015-08-10stat.ME

Empirical Likelihood Confidence Intervals for Nonparametric Functional Data Analysis

We consider the problem of constructing confidence intervals for nonparametric functional data analysis using empirical likelihood. In this doubly infinite-dimensional context, we demonstrate the Wilks's phenomenon and propose a bias-corrected construction that requires neither undersmoothing nor direct bias estimation. We also extend our results to partially linear regression involving functional data. Our numerical results demonstrated the improved performance of empirical likelihood over approximation based on asymptotic normality.

2009-04-06stat.ME

Profile-Kernel likelihood inference with diverging number of parameters

The generalized varying coefficient partially linear model with growing number of predictors arises in many contemporary scientific endeavor. In this paper we set foot on both theoretical and practical sides of profile likelihood estimation and inference. When the number of parameters grows with sample size, the existence and asymptotic normality of the profile likelihood estimator are established under some regularity conditions. Profile likelihood ratio inference for the growing number of parameters is proposed and Wilk's phenomenon is demonstrated. A new algorithm, called the accelerated pr…

2007-09-21math.STstat.TH

Curve registration by nonparametric goodness-of-fit testing

The problem of curve registration appears in many different areas of applications ranging from neuroscience to road traffic modeling. In the present work, we propose a nonparametric testing framework in which we develop a generalized likelihood ratio test to perform curve registration. We first prove that, under the null hypothesis, the resulting test statistic is asymptotically distributed as a chi-squared random variable. This result, often referred to as Wilks' phenomenon, provides a natural threshold for the test of a prescribed asymptotic significance level and a natural measure of lack-o…

2015-02-19math.STstat.TH

更多相关论文收起更多论文

Nonparametric specification for non-stationary time series regression

We investigate the behavior of the Generalized Likelihood Ratio Test (GLRT) (Fan, Zhang and Zhang [Ann. Statist. 29 (2001) 153-193]) for time varying coefficient models where the regressors and errors are non-stationary time series and can be cross correlated. It is found that the GLRT retains the minimax rate of local alternative detection under weak dependence and non-stationarity. However, in general, the Wilks phenomenon as well as the classic residual bootstrap are sensitive to either conditional heteroscedasticity of the errors, non-stationarity or temporal dependence. An averaged test i…

2014-02-04math.STstat.TH

Local and global asymptotic inference in smoothing spline models

This article studies local and global inference for smoothing spline estimation in a unified asymptotic framework. We first introduce a new technical tool called functional Bahadur representation, which significantly generalizes the traditional Bahadur representation in parametric models, that is, Bahadur [Ann. Inst. Statist. Math. 37 (1966) 577-580]. Equipped with this tool, we develop four interconnected procedures for inference: (i) pointwise confidence interval; (ii) local likelihood ratio testing; (iii) simultaneous confidence band; (iv) global likelihood ratio testing. In particular, our…

2013-11-26math.STstat.MLstat.TH

Support vector machines and linear regression coincide with very high-dimensional features

Columbia University（哥伦比亚大学）

The support vector machine (SVM) and minimum Euclidean norm least squares regression are two fundamentally different approaches to fitting linear models, but they have recently been connected in models for very high-dimensional data through a phenomenon of support vector proliferation, where every training example used to fit an SVM becomes a support vector. In this paper, we explore the generality of this phenomenon and make the following contributions. First, we prove a super-linear lower bound on the dimension (in terms of sample size) required for support vector proliferation in independen…

2021-10-27cs.LGmath.STstat.ML

Enhancements of nonparametric generalized likelihood ratio test: Bias-correction and dimension reduction

Nonparametric generalized likelihood ratio test is popularly used for model checking for regressions. However, there are two issues that may be the barriers for its powerfulness. First, the bias term in its liming null distribution causes the test not to well control type I error and thus Monte Carlo approximation for critical value determination is required. Second, it severely suffers from the curse of dimensionality due to the use of multivariate nonparametric function estimation. The purpose of this paper is thus two-fold: a bias-correction is suggested to this test and a dimension reducti…

2015-07-22stat.ME

Joint asymptotics for semi-nonparametric regression models with partially linear structure

We consider a joint asymptotic framework for studying semi-nonparametric regression models where (finite-dimensional) Euclidean parameters and (infinite-dimensional) functional parameters are both of interest. The class of models in consideration share a partially linear structure and are estimated in two general contexts: (i) quasi-likelihood and (ii) true likelihood. We first show that the Euclidean estimator and (pointwise) functional estimator, which are re-scaled at different rates, jointly converge to a zero-mean Gaussian vector. This weak convergence result reveals a surprising joint as…

2015-06-03math.STstat.TH

超越逻辑回归对数似然比的现代渐近理论

Beyond Modern Asymptotics for Log-Likelihood Ratios in Logistic Regression

University of California, Berkeley（加州大学伯克利分校）；Cornell University（康奈尔大学）

该研究刻画二元逻辑回归对数似然比统计量的有限样本行为，推导不同维度下的非渐近分位数界，其界在目标参数上一致，无需设计正则假设，补充了 Wilks 渐近理论的非渐近结果。

2026-08-04cs.ITcs.LGmath.IT

它“全”是为了“无”：无噪声离散信道的尖锐相变

It was "all" for "nothing": sharp phase transitions for noiseless discrete channels

本文为无噪声离散信道建立了“全或无”相变现象，将结果扩展至任意次线性稀疏信号，并证明“全”部分蕴含“无”部分，提供了一种通用证明方法。

2023-04-10cs.ITmath.ITmath.PR