arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2411.08975eess.IVcs.AIcs.CV

Fluoroformer:通过基于注意力的通道融合将多示例学习扩展到多重免疫图像

Fluoroformer: Scaling multiple instance learning to multiplexed images via attention-based channel fusion

Dana-Farber Cancer Institute(达纳-法伯癌症研究所)

Marc Harary, Eliezer M. Van Allen, William Lotter

AI总结:

针对多重免疫全切片图像,提出基于缩放点积注意力的Fluoroformer模块进行多示例学习与通道融合,在434例非小细胞肺癌样本中实现强预后性能并重现免疫学特征,为AI适配新兴空间生物学检测提供途径。

摘要:

尽管多示例学习(MIL)一直是计算病理学中处理全切片图像(WSIs)的基础策略,但当前方法是为传统的苏木精-伊红(H&E)切片设计的,而非针对新兴的多重免疫技术。在此,我们提出了一种MIL策略——Fluoroformer模块,该模块专门针对多重免疫WSIs量身定制,利用缩放点积注意力(SDPA)以可解释的方式融合不同通道间的信息。在434个非小细胞肺癌(NSCLC)样本队列中,我们表明Fluoroformer不仅获得了强大的预后性能,还重现了NSCLC的免疫肿瘤学特征。因此,我们的技术为将最先进的AI技术适配到新兴的空间生物学检测中提供了一条途径。

英文摘要:

Though multiple instance learning (MIL) has been a foundational strategy in computational pathology for processing whole slide images (WSIs), current approaches are designed for traditional hematoxylin and eosin (H&E) slides rather than emerging multiplexed technologies. Here, we present an MIL strategy, the Fluoroformer module, that is specifically tailored to multiplexed WSIs by leveraging scaled dot-product attention (SDPA) to interpretably fuse information across disparate channels. On a cohort of 434 non-small cell lung cancer (NSCLC) samples, we show that the Fluoroformer both obtains strong prognostic performance and recapitulates immuno-oncological hallmarks of NSCLC. Our technique thereby provides a path for adapting state-of-the-art AI techniques to emerging spatial biology assays.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑