arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2501.14679cs.CVcs.AI

Surface Vision Mamba:利用双向状态空间模型实现高效球面流形表示

Surface Vision Mamba: Leveraging Bidirectional State Space Model for Efficient Spherical Manifold Representation

Lanzhou University(兰州大学);Harbin Institute of Technology(哈尔滨工业大学);Gansu Maternity and Child-care Hospital(甘肃省妇幼保健院);Zhejiang University(浙江大学)

Rongzhao He, Weihao Zheng, Leilei Zhao, Ying Wang, Dalin Zhu, Dan Wu, Bin Hu

AI总结:

本文提出 Surface Vision Mamba(SiM),利用双向状态空间模型与三角形面片序列高效表示球面皮层数据,在新生儿表型回归中超越注意力和 GDL 方法,并显著降低推理时间与内存消耗。

摘要:

基于注意力的方法在建模球面皮层表面的长程依赖方面表现出卓越性能,超越了传统的几何深度学习(GDL)模型。然而,其冗长的推理时间和高昂的内存需求,给在计算资源有限的情况下应用于大型数据集带来了挑战。受计算机视觉中状态空间模型的启发,我们将无注意力的 Vision Mamba(Vim)引入球面表面,提出了一种用于分析球面流形数据的领域无关架构。我们的方法通过将球面数据表示为由细分二十面体球面生成的三角形面片序列,实现表面分块。所提出的 Surface Vision Mamba(SiM)在多项神经发育表型回归任务上进行了评估,这些任务使用新生儿大脑的皮层表面指标。实验结果表明,SiM 优于基于注意力和基于 GDL 的方法;在 Ico-4 网格划分下,与 Surface Vision Transformer(SiT)相比,其推理速度提升 4.8 倍,内存消耗降低 91.7%。敏感性分析进一步凸显了 SiM 识别细微认知发育模式的潜力。代码可在 https://github.com/Rongzhao-He/surface-vision-mamba 获取。

英文摘要:

Attention-based methods have demonstrated exceptional performance in modelling long-range dependencies on spherical cortical surfaces, surpassing traditional Geometric Deep Learning (GDL) models. However, their extensive inference time and high memory demands pose challenges for application to large datasets with limited computing resources. Inspired by the state space model in computer vision, we introduce the attention-free Vision Mamba (Vim) to spherical surfaces, presenting a domain-agnostic architecture for analyzing data on spherical manifolds. Our method achieves surface patching by representing spherical data as a sequence of triangular patches derived from a subdivided icosphere. The proposed Surface Vision Mamba (SiM) is evaluated on multiple neurodevelopmental phenotype regression tasks using cortical surface metrics from neonatal brains. Experimental results demonstrate that SiM outperforms both attention- and GDL-based methods, delivering 4.8 times faster inference and achieving 91.7% lower memory consumption compared to the Surface Vision Transformer (SiT) under the Ico-4 grid partitioning. Sensitivity analysis further underscores the potential of SiM to identify subtle cognitive developmental patterns. The code is available at https://github.com/Rongzhao-He/surface-vision-mamba.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑