arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2609.32537cs.CVcs.NE

RIPE-MambaSpike:用于参数高效事件视觉的分辨率无关尖峰状态空间接口

RIPE-MambaSpike: Resolution-Independent Spiking-State-Space Interfaces for Parameter-Efficient Event-Based Vision

Md Muhiminul Islam, Shoaib Ahmed Dipu, Sayeed Shafayet Chowdhury

首次发表
浏览论文内容

中文总结 AI 辅助

提出分辨率无关参数高效的RIPE-MambaSpike,以固定通道宽度的分层多分辨率桥接替代高成本投影,在紧凑参数下保持精度,并在多个事件视觉基准上达到最优。

中文摘要 AI 辅助

Spiking-Mamba混合模型在事件视觉上达到了较高的精度,但现有设计通常需要数千万个参数。大部分成本来自尖峰前端与状态空间骨干网络的连接方式,而非混合架构本身。在一个代表性模型中,单个依赖分辨率的投影就占据了36.25M参数中的33.55M。为此,我们提出了RIPE-MambaSpike(分辨率无关、参数高效),用固定通道宽度的分层多分辨率桥接取代该投影。其部署参数量为0.870M,在输入面积43倍范围内,固定时间步和宽度下保持不变。重参数化尖峰阶段、时间解耦调制以及动态凸包界双流膜电位注意力,在紧凑设计下保持了精度。在结果上,RIPE-MambaSpike在CIFAR10-DVS、N-Caltech101和DailyDVS-200上达到帕累托最优。值得注意的是,在200类DailyDVS-200上,缩放后的8.04M配置实现了45.7%的top-1精度,是该基准上报告的最佳尖峰结果,并且比密集ANN的参数少3.0-15.1倍。总体而言,我们的发现表明,竞争性的事件识别并不需要依赖分辨率的参数增长。代码可在该https URL获取。

英文摘要

Spiking-Mamba hybrids reach strong accuracy on event-based vision, but existing designs often require tens of millions of parameters. Much of that cost comes from how the spiking front-end is connected to the state-space backbone rather than from the hybrid architecture itself. In a representative model, a single resolution-dependent projection accounts for 33.55M of 36.25M parameters. To that end, we introduce RIPE-MambaSpike (Resolution-Independent, Parameter-Efficient), which replaces that projection with a hierarchical multi-resolution bridge of fixed channel width. Its deployed footprint is 0.870M parameters, constant at fixed time steps and widths across a 43x range of input areas. Reparameterized spiking stages, temporal decoupled modulation, and a dynamic convex-hull-bounded dual-stream membrane-potential attention preserve accuracy under this compact design. Result-wise, RIPE-MambaSpike is pareto-optimal on CIFAR10-DVS, N-Caltech101, and DailyDVS-200. Notably, on the 200-class DailyDVS-200, a scaled 8.04M configuration achieves 45.7% top-1 accuracy, the best reported spiking result on that benchmark, and outperforms prior spiking methods with 3.0-15.1x fewer parameters than dense ANNs. Overall, our findings demonstrate that competitive event-based recognition does not require resolution-dependent parameter growth. Code is available at https://github.com/MuhiminOsim/RIPE-MambaSpike.

↑