arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2410.06451stat.MEstat.AP
收藏

用于聚类后检验的基于数据拆分的错误发现率控制方法

False Discovery Rate Control via Data Splitting for Testing-after-Clustering

Lijun Wang, Yingxin Lin, Hongyu Zhao

AI总结:

针对聚类后特征检验的“双重蘸取”假阳性膨胀问题,提出基于数据拆分的FDR控制方法,含单次与多重拆分方案,经理论证明与实验验证,适配单细胞分析流程且弱信号下表现更优。

摘要:

在各类应用中,当研究者使用同一数据集先识别聚类再进行特征差异检验时,往往会导致假阳性结果膨胀,这一问题通常被称为“双重蘸取(double dipping)”。为应对这一挑战,受回归分析中用于控制错误发现率(FDR)的数据拆分策略(Dai等人,2023)启发,我们提出了一种新方法,在无监督聚类场景下应用数据拆分控制FDR,同时保持较高的检验效能。我们首先将数据集拆分为两半,随后分别对每一半执行传统的聚类后检验流程,再将得到的检验统计量合并,为每个特征构建新的统计量。该新统计量具备零假设下特征的抽样分布关于零对称的性质,可用于控制FDR。为进一步提升稳定性和检验效能,我们提出多重数据拆分方案,即重复执行数据拆分并合并结果。我们从数学上证明了所提出的数据拆分方法在高斯设定下可渐近控制FDR。通过大量模拟实验以及对单细胞RNA测序(scRNA-seq)数据集的分析,我们表明该数据拆分方法易于实现,可适配现有单细胞数据分析流程,且在处理弱信号、特征间高相关性的场景时通常优于其他方法。

英文摘要:

Testing for differences in features between clusters in various applications often leads to inflated false positives when practitioners use the same dataset to identify clusters and then test features, an issue commonly known as ``double dipping''. To address this challenge, inspired by data-splitting strategies for controlling the false discovery rate (FDR) in regressions \parencite{daiFalseDiscoveryRate2023}, we present a novel method that applies data-splitting to control FDR while maintaining high power in unsupervised clustering. We first divide the dataset into two halves, then apply the conventional testing-after-clustering procedure to each half separately and combine the resulting test statistics to form a new statistic for each feature. The new statistic can help control the FDR due to its property of having a sampling distribution that is symmetric around zero for any null feature. To further enhance stability and power, we suggest multiple data splitting, which involves repeatedly splitting the data and combining results. Our proposed data-splitting methods are mathematically proven to asymptotically control FDR in Gaussian settings. Through extensive simulations and analyses of single-cell RNA sequencing (scRNA-seq) datasets, we demonstrate that the data-splitting methods are easy to implement, adaptable to existing single-cell data analysis pipelines, and often outperform other approaches when dealing with weak signals and high correlations among features.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑