单细胞Transformer表示中的生物知识多维谱几何
Multi-Dimensional Spectral Geometry of Biological Knowledge in Single-Cell Transformer Representations
AI总结:
单细胞Transformer模型通过多维谱几何揭示生物知识结构,区分转录因子与靶基因,提升调控网络推断和模型审计能力。
摘要:
单细胞基础模型如scGPT学习高维基因表示,但这些表示编码了哪些生物知识仍不清楚。我们通过63次自动化假设筛选(测试了183个假设)系统地解码scGPT内部表示的几何结构,揭示模型将基因组织到一个结构化的生物坐标系统,而不是一个模糊的特征空间。主导的谱轴通过亚细胞定位分离基因,分泌蛋白位于一端,胞浆蛋白位于另一端。中间的Transformer层暂时编码线粒体和内质网 compartment,顺序与细胞分泌途径相匹配。正交轴编码蛋白质-蛋白质相互作用网络,其对实验测得的相互作用强度的保真度呈梯度(Spearman rho = 1.000,n = 5 STRING置信度 quintiles,p = 0.017)。在紧凑的六维谱子空间中,模型区分转录因子与其靶基因(AUROC = 0.744,所有12层显著)。早期层保留哪些特定基因调控哪些靶基因,而深层层将其压缩为更粗略的调控者与被调控的区别。抑制边比激活边在几何上更突出,B细胞主调控因子BATF和BACH2在Transformer深度中向B细胞身份锚PAX5收敛。细胞类型标记基因以高保真度聚类(AUROC = 0.851)。残差流几何编码与注意力模式互补的生物结构。这些结果表明,生物Transformer学习了可解释的细胞组织内部模型,对调控网络推断、药物靶点优先级和模型审计有启示。
英文摘要:
Single-cell foundation models such as scGPT learn high-dimensional gene representations, but what biological knowledge these representations encode remains unclear. We systematically decode the geometric structure of scGPT internal representations through 63 iterations of automated hypothesis screening (183 hypotheses tested), revealing that the model organizes genes into a structured biological coordinate system rather than an opaque feature space. The dominant spectral axis separates genes by subcellular localization, with secreted proteins at one pole and cytosolic proteins at the other. Intermediate transformer layers transiently encode mitochondrial and ER compartments in a sequence that mirrors the cellular secretory pathway. Orthogonal axes encode protein-protein interaction networks with graded fidelity to experimentally measured interaction strength (Spearman rho = 1.000 across n = 5 STRING confidence quintiles, p = 0.017). In a compact six-dimensional spectral subspace, the model distinguishes transcription factors from their target genes (AUROC = 0.744, all 12 layers significant). Early layers preserve which specific genes regulate which targets, while deeper layers compress this into a coarser regulator versus regulated distinction. Repression edges are geometrically more prominent than activation edges, and B-cell master regulators BATF and BACH2 show convergence toward the B-cell identity anchor PAX5 across transformer depth. Cell-type marker genes cluster with high fidelity (AUROC = 0.851). Residual-stream geometry encodes biological structure complementary to attention patterns. These results indicate that biological transformers learn an interpretable internal model of cellular organization, with implications for regulatory network inference, drug target prioritization, and model auditing.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。