arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2507.22477cs.CVcs.AI

LIDAR:面向结构裂缝多模态分割的轻量级自适应线索感知融合Vision Mamba

LIDAR: Lightweight Adaptive Cue-Aware Fusion Vision Mamba for Multimodal Segmentation of Structural Cracks

Tianjin University of Technology(天津理工大学);Hainan University(海南大学)

Hui Liu, Chen Jia, Fan Shi, Xu Cheng, Mengfei Shi, Xia Xie, Shengyong Chen

AI总结:

针对多模态裂缝分割中跨模态特征自适应感知与高效融合不足的问题,提出轻量级自适应线索感知Vision Mamba网络LIDAR,通过专用模块与策略实现低参数下的高精度像素级分割,性能优于现有SOTA方法。

摘要:

在裂缝分割任务中,利用多模态数据以低计算成本实现像素级分割仍是一项核心挑战。现有方法缺乏对跨模态特征的自适应感知与高效交互融合能力。为解决这些问题,我们提出轻量级自适应线索感知Vision Mamba网络(LIDAR),该网络能在多模态裂缝场景下高效感知并整合不同模态的形态与纹理线索,生成清晰的像素级裂缝分割图。具体而言,LIDAR由轻量级自适应线索感知视觉状态空间模块(LacaVSS)和轻量级双域动态协同融合模块(LD3CF)组成。LacaVSS通过提出的掩码引导高效动态引导扫描策略(EDG-SS)对裂缝线索进行自适应建模,而LD3CF利用自适应频域感知机(AFDP)和双池化融合策略,有效捕捉跨模态的空间与频域线索。此外,我们设计了轻量级动态调制多核卷积(LDMK),以极低的计算开销感知复杂形态结构,替代了LIDAR中的大部分卷积操作。在三个数据集上的实验表明,我们的方法优于其他现有最优(SOTA)方法。在光场深度数据集上,我们的方法仅用535万参数就实现了0.8204的F1值和0.8465的mIoU。代码与数据集可在https://github.com/Karl1109/LIDAR-Mamba 获取。

英文摘要:

Achieving pixel-level segmentation with low computational cost using multimodal data remains a key challenge in crack segmentation tasks. Existing methods lack the capability for adaptive perception and efficient interactive fusion of cross-modal features. To address these challenges, we propose a Lightweight Adaptive Cue-Aware Vision Mamba network (LIDAR), which efficiently perceives and integrates morphological and textural cues from different modalities under multimodal crack scenarios, generating clear pixel-level crack segmentation maps. Specifically, LIDAR is composed of a Lightweight Adaptive Cue-Aware Visual State Space module (LacaVSS) and a Lightweight Dual Domain Dynamic Collaborative Fusion module (LD3CF). LacaVSS adaptively models crack cues through the proposed mask-guided Efficient Dynamic Guided Scanning Strategy (EDG-SS), while LD3CF leverages an Adaptive Frequency Domain Perceptron (AFDP) and a dual-pooling fusion strategy to effectively capture spatial and frequency-domain cues across modalities. Moreover, we design a Lightweight Dynamically Modulated Multi-Kernel convolution (LDMK) to perceive complex morphological structures with minimal computational overhead, replacing most convolutional operations in LIDAR. Experiments on three datasets demonstrate that our method outperforms other state-of-the-art (SOTA) methods. On the light-field depth dataset, our method achieves 0.8204 in F1 and 0.8465 in mIoU with only 5.35M parameters. Code and datasets are available at https://github.com/Karl1109/LIDAR-Mamba.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑