Testing for differences in features between clusters in various applications often leads to inflated false positives when practitioners use the same dataset to identify clusters and then test features, an issue commonly known as ``double dipping''. To address this challenge, inspired by data-splitting strategies for controlling the false discovery rate (FDR) in regressions \parencite{daiFalseDiscoveryRate2023}, we present a novel method that applies data-splitting to control FDR while maintaining high power in unsupervised clustering. We first divide the dataset into two halves, then apply the conventional testing-after-clustering procedure to each half separately and combine the resulting test statistics to form a new statistic for each feature. The new statistic can help control the FDR due to its property of having a sampling distribution that is symmetric around zero for any null feature. To further enhance stability and power, we suggest multiple data splitting, which involves repeatedly splitting the data and combining results. Our proposed data-splitting methods are mathematically proven to asymptotically control FDR in Gaussian settings. Through extensive simulations and analyses of single-cell RNA sequencing (scRNA-seq) datasets, we demonstrate that the data-splitting methods are easy to implement, adaptable to existing single-cell data analysis pipelines, and often outperform other approaches when dealing with weak signals and high correlations among features.
A General Stability Approach to False Discovery Rate Control
Department of Statistics & Data Science, SOE, Xiamen University(厦门大学经济学院统计与数据科学系);Faculty of Business and Economics, University of Hong Kong(香港大学商学院);MOE Lab of Econometrics and WISE, Xiamen University(厦门大学经济计量学教育部重点实验室和WISE)
Conformal Network Link Prediction with False Discovery Rate Control under Unstructured Missingness
University of Southern California(南加州大学);University of Pennsylvania(宾夕法尼亚大学);Hong Kong University of Science and Technology(香港科技大学);Ohio State University(俄亥俄州立大学);New York University(纽约大学)