评估基因表达生成模型的标准框架
A Standardized Framework For Evaluating Gene Expression Generative Models
AI总结:
本文提出GGE框架,通过标准化评估方法解决基因表达生成模型中指标不一致、超参数不可比等问题,促进生成方法的公平比较和生物信息学研究进展。
摘要:
单细胞基因表达数据生成模型的快速发展催生了对标准化评估框架的迫切需求。当前的评估实践面临指标实现不一致、超参数选择不可比以及缺乏生物学基础指标的问题。我们提出了生成遗传表达评估器(GGE),这是一个开源的Python框架,通过提供全面的分布指标、明确的计算空间选项以及基于差异表达基因(DEG)分析和扰动效应相关性的生物学驱动评估,解决了这些挑战。通过广泛分析单细胞生成建模文献,我们发现不存在标准化评估协议。方法报告的指标在不同空间中以不同超参数计算,指标值因实现选择而有很大差异,突显了标准化的必要性。GGE使生成方法之间的公平比较成为可能,并加速了对扰动响应预测、细胞身份建模和反事实推断的进步。
英文摘要:
The rapid development of generative models for single-cell gene expression data has created an urgent need for standardised evaluation frameworks. Current evaluation practices suffer from inconsistent metric implementations, incomparable hyperparameter choices, and a lack of biologically-grounded metrics. We present Generated Genetic Expression Evaluator (GGE), an open-source Python framework that addresses these challenges by providing a comprehensive suite of distributional metrics with explicit computation space options and biologically-motivated evaluation through differentially expressed gene (DEG)-focused analysis and perturbation-effect correlation, enabling standardized reporting and reproducible benchmarking. Through extensive analysis of the single-cell generative modeling literature, we identify that no standardized evaluation protocol exists. Methods report incomparable metrics computed in different spaces with different hyperparameters. We demonstrate that metric values vary substantially depending on implementation choices, highlighting the critical need for standardization. GGE enables fair comparison across generative approaches and accelerates progress in perturbation response prediction, cellular identity modeling, and counterfactual inference.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。