arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.07475cs.LGq-bio.GN
收藏

基于双图注意力的大型单细胞RNA测序数据聚类

Bipartite Graph Attention-based Clustering for Large-scale scRNA-seq Data

Institute of Intelligent Information Processing, Shanxi University(山西大学智能信息处理研究院);Alliance Manchester Business School, The University of Manchester(曼彻斯特大学阿联酋商业学院)

Zhuomin Liang, Liang Bai, Xian Yang

AI总结:

BGFormer通过双图注意力机制实现大规模scRNA-seq数据的高效聚类,具有线性计算复杂度和高可扩展性。

摘要:

单细胞RNA测序(scRNA-seq)数据分析中,细胞聚类是一个关键任务,因为它将具有相似基因表达谱的细胞分组。Transformer作为一种强大的基础模型,已被应用于scRNA-seq聚类。其自注意力机制能够自动为同一簇内的细胞分配更高的注意力权重,增强簇之间的区分度。现有的scRNA-seq聚类方法,如基于图Transformer的模型,将每个细胞视为序列中的一个token。其计算和空间复杂度与细胞数量呈O(n²)关系,限制了其在大规模scRNA-seq数据集中的应用。为解决这一挑战,我们提出了一种基于双图Transformer的聚类模型(BGFormer)用于scRNA-seq数据。我们引入了一组可学习的锚点token作为共享参考点,以表示整个数据集。引入了双图注意力机制,以学习细胞和锚点token之间的相似性,使同一类别的细胞在嵌入空间中更接近。BGFormer的计算复杂度与细胞数量成线性关系,使其能够扩展到大规模数据集。在多个大规模scRNA-seq数据集上的实验结果展示了BGFormer的有效性和可扩展性。

英文摘要:

scRNA-seq clustering is a critical task for analyzing single-cell RNA sequencing (scRNA-seq) data, as it groups cells with similar gene expression profiles. Transformers, as powerful foundational models, have been applied to scRNA-seq clustering. Their self-attention mechanism automatically assigns higher attention weights to cells within the same cluster, enhancing the distinction between clusters. Existing methods for scRNA-seq clustering, such as graph transformer-based models, treat each cell as a token in a sequence. Their computational and space complexities are $\mathcal{O}(n^2)$ with respect to the number of cells, limiting their applicability to large-scale scRNA-seq datasets.To address this challenge, we propose a Bipartite Graph Transformer-based clustering model (BGFormer) for scRNA-seq data. We introduce a set of learnable anchor tokens as shared reference points to represent the entire dataset. A bipartite graph attention mechanism is introduced to learn the similarity between cells and anchor tokens, bringing cells of the same class closer together in the embedding space. BGFormer achieves linear computational complexity with respect to the number of cells, making it scalable to large datasets. Experimental results on multiple large-scale scRNA-seq datasets demonstrate the effectiveness and scalability of BGFormer.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑