arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2012.02936stat.MEstat.ML
收藏

层次聚类的选择性推理

Selective Inference for Hierarchical Clustering

Lucy L. Gao, Jacob Bien, Daniela Witten

摘要:

当组被先验定义时,平均值差异的经典检验控制第一类错误率。然而,当通过聚类来定义组时,则应用经典测试会产生极度膨胀的第一类错误率。值得注意的是,即使使用两个单独和独立的数据集来定义组并测试其均值的差异,这个问题仍然存在。为了解决这个问题,在本文中,我们提出了一个选择性的推理方法来测试两个集群之间的差异。我们的程序通过考虑原假设的选择是基于数据的事实来控制选择性第一类错误率。我们描述了如何有效地计算精确的p值的聚类使用凝聚层次聚类与许多常用的链接。我们将我们的方法应用于模拟数据和单细胞RNA测序数据。

英文摘要:

Classical tests for a difference in means control the type I error rate when the groups are defined a priori. However, when the groups are instead defined via clustering, then applying a classical test yields an extremely inflated type I error rate. Notably, this problem persists even if two separate and independent data sets are used to define the groups and to test for a difference in their means. To address this problem, in this paper, we propose a selective inference approach to test for a difference in means between two clusters. Our procedure controls the selective type I error rate by accounting for the fact that the choice of null hypothesis was made based on the data. We describe how to efficiently compute exact p-values for clusters obtained using agglomerative hierarchical clustering with many commonly-used linkages. We apply our method to simulated data and to single-cell RNA-sequencing data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑