For high-dimensional small sample size data, Hotelling's T2 test is not applicable for testing mean vectors due to the singularity problem in the sample covariance matrix. To overcome the problem, there are three main approaches in the literature. Note, however, that each of the existing approaches may have serious limitations and only works well in certain situations. Inspired by this, we propose a pairwise Hotelling method for testing high-dimensional mean vectors, which, in essence, provides a good balance between the existing approaches. To effectively utilize the correlation information, we construct the new test statistics as the summation of Hotelling's test statistics for the covariate pairs with strong correlations and the squared $t$ statistics for the individual covariates that have little correlation with others. We further derive the asymptotic null distributions and power functions for the proposed Hotelling tests under some regularity conditions. Numerical results show that our new tests are able to control the type I error rates, and can achieve a higher statistical power compared to existing methods, especially when the covariates are highly correlated. Two real data examples are also analyzed and they both demonstrate the efficacy of our pairwise Hotelling tests.
Elliptical Regularized Hotelling Testing for High Dimensional Data
School of Statistics and Data Science, Nankai University(南开大学统计与数据科学学院);Department of Mathematics, Hong Kong Baptist University(香港浸会大学数学系);Advanced Institute of Natural Sciences, Beijing Normal University(北京师范大学前沿交叉科学研究院)
Random Projection Tests via Cauchy Combination for Two-Sample Mean
School of Sciences, Chang’an University(长安大学理学院);Center for Statistics and Data Science, Beijing Normal University(北京师范大学统计与数据科学中心);Center for Applied Statistics and School of Statistics, Renmin University of China(中国人民大学应用统计中心及统计学院)
Block-Independent Likelihood Ratio Testing for High-Dimensional Mean Vectors with Applications to Matrix-Variate Data
Seoul National University(首尔大学);Inha University(仁荷大学);Nathan S. Kline Institute for Psychiatric Research(内森·S·克莱恩精神医学研究所);NYU Grossman School of Medicine(纽约大学格罗斯曼医学院)
Cauchy-Combined Hettmansperger-Randles Location Tests in High Dimensions
School of Mathematical Sciences, Tiangong University(天津大学数学科学学院);School of Statistics and Data Science, Nankai University(南开大学统计与数据科学学院);Faculty of Arts and Sciences, Beijing Normal University(北京师范大学文理学院)
A new non-parametric test for multivariate paired data from pair matching or paired designs
School of Data Science, Fudan University(复旦大学数据科学学院);Department of Statistics, University of California, Davis(加州大学戴维斯分校统计系);Beijing International Center for Mathematical Research and School of Public Health, Peking University(北京大学北京国际数学研究中心与公共卫生学院)
在这篇文章中,我们提出了一种新的方法来测试两组变量之间的依赖关系的基本任务。独立性的原假设和相关性的备择假设下的响应密度由非参数贝叶斯模型确定。在原假设下,联合分布由两个独立的Dirichlet过程混合(Dirichlet Process Mixture,DIFR)先验的乘积建模;在另一种情况下,全联合密度由多变量DIFR先验建模。然后,检验基于支持备择假设的后验概率。该检验不仅在线性相关性检验方面具有良好的性能,而且在非线性相关性检验方面也优于其他方法。在基因表达数据的分析中,我们比较了不同的方法来测试基因之间的成对依赖性。结果表明,该测试确定了一些依赖结构,没有检测到的其他测试。
Differential expression analysis for multiple conditions
随着高通量测序已成为普遍做法,测序大量遗传数据的成本已大幅降低,从而导致更大的数据集用于分析。一个重要的任务是确定导致特定基因异常高或低表达的生物条件。DESeq等软件包实现了一种简单的方法,用于在两种生物条件下测试差分信号。对于两个以上的条件,通常使用成对测试。在这里,DESeq方法被扩展,以便可以同时评估三种或更多种生物条件。由于计算时间随条件的数量呈指数级增长,因此蒙特卡罗方法提供了一种快速方法来近似新测试的$p$值。在模拟数据和{ \em C. jejuni),这种细菌是美国大多数食物中毒的罪魁祸首。
Beyond Normality: Reliable A/B Testing with Non-Gaussian Data
School of Mathematical Sciences, University of Chinese Academy of Sciences(中国科学院大学数学科学学院);SKLMS, Academy of Mathematics and Systems Science, Chinese Academy of Sciences(中国科学院数学与系统科学研究院SKLMS);Peking University(北京大学)
On Testing Independence and Goodness-of-fit in Linear Models
我们考虑了一个线性回归模型,并提出了一个综合测试,同时检查的假设之间的误差和预测变量,以及拟合优度的参数模型。我们的方法是基于使用希尔伯特-施密特独立性标准(Gretton et al.(2008))测试从参数拟合获得的残差与预测值之间的独立性。所提出的方法不需要用户定义的正则化,计算简单,仅基于样本中点之间的成对距离,并且对所有替代方案都是一致的。我们在零假设和备择假设下为拟议的检验统计量开发了分布理论,并设计了一个自助方案来逼近其零分布。我们证明了自举方案的一致性。仿真研究表明,我们的方法具有更好的功率比它的主要竞争对手。两个真实的数据集进行了分析,以证明我们的方法的范围和实用性。