LangCell:面向细胞身份理解的语言-细胞预训练
LangCell: Language-Cell Pre-training for Cell Identity Understanding
AI总结:
本文提出首个语言-细胞预训练框架LangCell,通过统一单细胞转录组数据与自然语言表示,使模型在零样本、少样本及微调场景下显著提升细胞身份理解能力。
摘要:
细胞身份涵盖细胞的多种语义方面,包括细胞类型、通路信息、疾病信息等,这些对于生物学家深入了解细胞的生物学特性至关重要。从转录组数据中理解细胞身份,例如进行细胞类型注释,已成为生物信息学中的一项重要任务。由于这些语义方面由人类专家确定,如果没有单细胞数据与标签对所提供的监督信号,AI模型不可能有效完成细胞身份理解任务。目前用于该任务的单细胞预训练语言模型(PLMs)仅在单一模态即转录组数据上进行训练,缺乏对细胞身份知识的理解。因此,它们必须针对下游任务进行微调,并且在缺乏具有所需语义标签的标注数据时表现困难。为解决这一问题,我们提出了一种创新方案:在预训练阶段构建单细胞数据与自然语言的统一表示,使模型能够直接融入与细胞身份相关的见解。具体而言,我们引入了LangCell,这是第一个语言-细胞预训练框架。LangCell利用富含细胞身份信息的文本来获得对跨模态知识的深刻理解。在不同基准上进行的实验结果表明,LangCell是唯一能够在零样本细胞身份理解场景中有效工作的单细胞PLM,并且在少样本和微调细胞身份理解场景中也显著优于现有模型。
英文摘要:
Cell identity encompasses various semantic aspects of a cell, including cell type, pathway information, disease information, and more, which are essential for biologists to gain insights into its biological characteristics. Understanding cell identity from the transcriptomic data, such as annotating cell types, has become an important task in bioinformatics. As these semantic aspects are determined by human experts, it is impossible for AI models to effectively carry out cell identity understanding tasks without the supervision signals provided by single-cell and label pairs. The single-cell pre-trained language models (PLMs) currently used for this task are trained only on a single modality, transcriptomics data, lack an understanding of cell identity knowledge. As a result, they have to be fine-tuned for downstream tasks and struggle when lacking labeled data with the desired semantic labels. To address this issue, we propose an innovative solution by constructing a unified representation of single-cell data and natural language during the pre-training phase, allowing the model to directly incorporate insights related to cell identity. More specifically, we introduce $\textbf{LangCell}$, the first $\textbf{Lang}$uage-$\textbf{Cell}$ pre-training framework. LangCell utilizes texts enriched with cell identity information to gain a profound comprehension of cross-modal knowledge. Results from experiments conducted on different benchmarks show that LangCell is the only single-cell PLM that can work effectively in zero-shot cell identity understanding scenarios, and also significantly outperforms existing models in few-shot and fine-tuning cell identity understanding scenarios.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。