arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2402.12946cs.CV
收藏

用于细胞核分类的细胞图Transformer

Cell Graph Transformer for Nuclei Classification

Shenzhen Research Institute of Big Data(深圳大数据研究院);The Chinese University of Hong Kong(香港中文大学);Sun Yat-sen University(中山大学)

Wei Lou, Guanbin Li, Xiang Wan, Haofeng Li

AI总结:

本文提出细胞图Transformer(CGT),将节点和边作为输入token实现全节点信息交换,并结合拓扑感知预训练方法缓解噪声自注意力问题,显著提升细胞核分类性能并达到最先进水平。

摘要:

细胞核分类是组织病理学图像计算机辅助诊断中的关键步骤。过去,各种方法采用图神经网络(GNN)分析细胞图,通过将细胞核视为顶点来建模细胞间关系。然而,它们受限于GNN机制,该机制仅通过固定边在局部节点之间传递消息。为解决这一问题,我们开发了一种细胞图Transformer(CGT),它将节点和边作为输入token,以实现可学习的邻接关系以及所有节点之间的信息交换。尽管如此,用细胞图训练Transformer带来了另一个挑战。初始化不佳的特征可能导致噪声自注意力分数和较差的收敛性,尤其是在处理具有大量连接的细胞图时。因此,我们进一步提出了一种新颖的拓扑感知预训练方法,利用图卷积网络(GCN)学习特征提取器。预训练的特征可以抑制不合理的相关性,从而简化CGT的微调。实验结果表明,所提出的具有拓扑感知预训练的细胞图Transformer显著改善了细胞核分类结果,并达到了最先进的性能。代码和模型可在https://github.com/lhaof/CGT获取。

英文摘要:

Nuclei classification is a critical step in computer-aided diagnosis with histopathology images. In the past, various methods have employed graph neural networks (GNN) to analyze cell graphs that model inter-cell relationships by considering nuclei as vertices. However, they are limited by the GNN mechanism that only passes messages among local nodes via fixed edges. To address the issue, we develop a cell graph transformer (CGT) that treats nodes and edges as input tokens to enable learnable adjacency and information exchange among all nodes. Nevertheless, training the transformer with a cell graph presents another challenge. Poorly initialized features can lead to noisy self-attention scores and inferior convergence, particularly when processing the cell graphs with numerous connections. Thus, we further propose a novel topology-aware pretraining method that leverages a graph convolutional network (GCN) to learn a feature extractor. The pre-trained features may suppress unreasonable correlations and hence ease the finetuning of CGT. Experimental results suggest that the proposed cell graph transformer with topology-aware pretraining significantly improves the nuclei classification results, and achieves the state-of-the-art performance. Code and models are available at https://github.com/lhaof/CGT

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑