arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~

MUL-T:解码多重组织图像中的空间细胞结构

MUL-T: Decoding Spatial Cellular Architecture in Multiplexed Tissue Images

Farzaneh Seyedshahi, Kai Rakovic, Adalberto Claudio Quiros, John LeQuesne, Ke Yuan

arXiv 2607.28030首次发表:更新:

发表机构

Cancer Research UK Scotland Institute; University of Glasgow(英国癌症研究苏格兰研究所; 格拉斯哥大学)

机构由 AI 辅助整理,请以论文原文为准。

AI 中文总结

本研究提出轻量级Transformer框架MUL-T,以离散细胞标记的掩码上下文预测任务建模组织结构,在多项临床任务中性能优于经典基线,与基础ViT相当且成本更低。

AI 中文摘要

理解多重成像中的组织结构需要同时建模细胞表型及其空间上下文。现有方法通常依赖手工设计的特征,如标记强度统计或细胞类型比例,这些方法往往无法扩展或在具有异质性标记面板的队列中泛化。我们提出了MUL-T,一个轻量级Transformer框架,将组织结构重新定义为对离散细胞标记的掩码上下文预测任务。通过学习上下文化的[CLS]嵌入且无需特定任务监督,该模型能捕捉高阶细胞相互作用,同时保持计算效率。我们在多个临床相关下游任务上评估了MUL-T,包括核心级肿瘤模式分类、患者分级、PD-L1阳性预测及跨数据集治疗反应预测。在所有任务中,MUL-T均持续优于经典基于特征的基线,且尽管参数数量显著更少、训练成本更低,仍达到了与基础ViT模型相当的性能。

英文摘要

Understanding tissue organisation in multiplexed imaging requires modelling both cellular phenotypes and their spatial context. Existing approaches typically rely on handcrafted features, such as marker intensity statistics or cell-type proportions, which often fail to scale or generalise across cohorts with heterogeneous marker panels. We introduce MUL-T, a lightweight transformer framework that reframes tissue architecture as a masked contextual prediction task over discrete cell tokens. By learning contextualised [CLS] embeddings without task-specific supervision, the model captures higher-order cellular interactions while remaining computationally efficient. We evaluate MUL-T on several clinically relevant downstream tasks, including core-level tumour pattern classification, patient-level grading, PD-L1 positivity prediction, and cross-dataset treatment response prediction. Across tasks, MUL-T consistently outperforms classical feature-based baselines and achieves performance comparable to a foundation ViT model, despite substantially fewer parameters and lower training cost.

论文原文

arXiv 摘要页 · PDF 原文 · HTML 原文

↑