arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.17857cs.CVcs.AI
收藏

Mew:通过高效多重网络进行多重免疫荧光图像分析

Mew: Multiplexed Immunofluorescence Image Analysis through an Efficient Multiplex Network

University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校);University of Science and Technology of China(中国科学技术大学);Enable Medicine;KAIST(韩国科学技术院);MIT(麻省理工学院);Harvard University(哈佛大学)

Sukwon Yun, Jie Peng, Alexandro E. Trevino, Chanyoung Park, Tianlong Chen

AI总结:

针对多重免疫荧光图像分析中细胞异质性与可扩展性挑战,提出Mew框架,构建Voronoi与Cell-type双重网络并结合高效GNN与可解释注意力模块,实现全图训练与图像分类,显著提升分析效能。

摘要:

近期,基于图的方法在多重免疫荧光(mIF)图像领域的进展显著推动了该领域的发展,为患者水平的表型分析提供了更深入的见解。然而,当前基于图的方法面临两个主要挑战:(1)细胞异质性,现有方法未能充分解决图中固有的归纳偏置,特别是细胞连接中观察到的同质性特征;(2)可扩展性,处理来自高维图像的细胞图在管理大量细胞时面临困难。为了克服这些局限性,我们引入了Mew,这是一种新颖的框架,旨在通过多重网络的视角高效处理mIF图像。Mew创新性地构建了一个包含两个不同层的多重网络:用于几何信息的Voronoi网络和用于捕获细胞同质性的Cell-type网络。该框架配备了一个可扩展且高效的图神经网络(GNN),能够在训练期间处理整个图。此外,Mew集成了一个可解释的注意力模块,可自主识别用于图像分类的相关层。在来自多个机构的真实患者数据集上的大量实验突显了Mew的卓越效能和效率,标志着mIF图像分析的重大进步。Mew的源代码可在此处找到:\url{https://github.com/UNITES-Lab/Mew}

英文摘要:

Recent advancements in graph-based approaches for multiplexed immunofluorescence (mIF) images have significantly propelled the field forward, offering deeper insights into patient-level phenotyping. However, current graph-based methodologies encounter two primary challenges: (1) Cellular Heterogeneity, where existing approaches fail to adequately address the inductive biases inherent in graphs, particularly the homophily characteristic observed in cellular connectivity and; (2) Scalability, where handling cellular graphs from high-dimensional images faces difficulties in managing a high number of cells. To overcome these limitations, we introduce Mew, a novel framework designed to efficiently process mIF images through the lens of multiplex network. Mew innovatively constructs a multiplex network comprising two distinct layers: a Voronoi network for geometric information and a Cell-type network for capturing cell-wise homogeneity. This framework equips a scalable and efficient Graph Neural Network (GNN), capable of processing the entire graph during training. Furthermore, Mew integrates an interpretable attention module that autonomously identifies relevant layers for image classification. Extensive experiments on a real-world patient dataset from various institutions highlight Mew's remarkable efficacy and efficiency, marking a significant advancement in mIF image analysis. The source code of Mew can be found here: \url{https://github.com/UNITES-Lab/Mew}

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑