GenoHoption:连接基因网络图与单细胞基础模型
GenoHoption: Bridging Gene Network Graphs and Single-Cell Foundation Models
AI总结:
GenoHoption提出新框架,融合单细胞基础模型与基因网络图,通过约束学习扩大感受野,在细胞类型注释和扰动预测上分别提升1.27%和3.86%,并降低计算开销。
摘要:
基础模型取得的显著成功引发了人们对其在单细胞生物学中应用的日益浓厚的兴趣。像Geneformer和scGPT这样的模型有望在这一专业领域充当多功能工具。然而,由于基因的顺序是可互换的,将细胞表示为基因序列仍然是一个悬而未决的问题。注入基因网络图提供了基因的相对位置和紧凑的数据表示,但带来了一个两难困境:没有层内消息传递时感受野有限,或者在每一层进行消息传递时参数爆炸。为了开辟前进的道路,我们提出了GenoHoption,一种用于单细胞测序数据的新计算框架,它轻松地将这些基础模型的优势与基因网络中的显式关系结合起来。我们还引入了一个约束,通过专注于学习预定义的图结构来减轻模型负担,同时确保扣除进一步的跳跃以扩大感受野。实证研究表明,我们的模型在细胞类型注释上平均提高了1.27%,在扰动预测上平均提高了3.86%。此外,我们的方法显著降低了计算开销,并展现出少样本潜力。GenoHoption可以作为一个高效且富有表现力的桥梁,连接现有的单细胞基础模型与基因网络图。
英文摘要:
The remarkable success of foundation models has sparked growing interest in their application to single-cell biology. Models like Geneformer and scGPT promise to serve as versatile tools in this specialized field. However, representing a cell as a sequence of genes remains an open question since the order of genes is interchangeable. Injecting the gene network graph offers gene relative positions and compact data representation but poses a dilemma: limited receptive fields without in-layer message passing or parameter explosion with message passing in each layer. To pave the way forward, we propose GenoHoption, a new computational framework for single-cell sequencing data that effortlessly combines the strengths of these foundation models with explicit relationships in gene networks. We also introduce a constraint that lightens the model by focusing on learning the predefined graph structure while ensuring further hops are deducted to expand the receptive field. Empirical studies show that our model improves by an average of 1.27% on cell-type annotation and 3.86% on perturbation prediction. Furthermore, our method significantly decreases computational overhead and exhibits few-shot potential. GenoHoption can function as an efficient and expressive bridge, connecting existing single-cell foundation models to gene network graphs.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。