Fluoroformer:通过基于注意力的通道融合将多示例学习扩展到多重免疫图像
Fluoroformer: Scaling multiple instance learning to multiplexed images via attention-based channel fusion
AI总结:
针对多重免疫全切片图像,提出基于缩放点积注意力的Fluoroformer模块进行多示例学习与通道融合,在434例非小细胞肺癌样本中实现强预后性能并重现免疫学特征,为AI适配新兴空间生物学检测提供途径。
摘要:
尽管多示例学习(MIL)一直是计算病理学中处理全切片图像(WSIs)的基础策略,但当前方法是为传统的苏木精-伊红(H&E)切片设计的,而非针对新兴的多重免疫技术。在此,我们提出了一种MIL策略——Fluoroformer模块,该模块专门针对多重免疫WSIs量身定制,利用缩放点积注意力(SDPA)以可解释的方式融合不同通道间的信息。在434个非小细胞肺癌(NSCLC)样本队列中,我们表明Fluoroformer不仅获得了强大的预后性能,还重现了NSCLC的免疫肿瘤学特征。因此,我们的技术为将最先进的AI技术适配到新兴的空间生物学检测中提供了一条途径。
英文摘要:
Though multiple instance learning (MIL) has been a foundational strategy in computational pathology for processing whole slide images (WSIs), current approaches are designed for traditional hematoxylin and eosin (H&E) slides rather than emerging multiplexed technologies. Here, we present an MIL strategy, the Fluoroformer module, that is specifically tailored to multiplexed WSIs by leveraging scaled dot-product attention (SDPA) to interpretably fuse information across disparate channels. On a cohort of 434 non-small cell lung cancer (NSCLC) samples, we show that the Fluoroformer both obtains strong prognostic performance and recapitulates immuno-oncological hallmarks of NSCLC. Our technique thereby provides a path for adapting state-of-the-art AI techniques to emerging spatial biology assays.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。