arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.00138cs.CV
收藏

潜在回放检测:通过任务自适应压缩在微控制器上实现内存高效的持续目标检测

Latent Replay Detection: Memory-Efficient Continual Object Detection on Microcontrollers via Task-Adaptive Compression

Independent Researcher(独立研究者)

Bibin Wilson

AI总结:

LRD通过任务自适应压缩和空间多样的示例选择,在MCU内存限制下实现高效的持续目标检测。

摘要:

在微控制器(MCUs)上部署目标检测使智能边缘设备智能化,但当前模型在部署后无法学习新目标类别。现有的持续学习方法需要存储原始图像,这远远超过了MCU内存预算的几十千字节。我们提出了潜在回放检测(LRD),这是第一个在MCU内存约束下实现持续目标检测的框架。我们的主要贡献是:1. 任务自适应压缩:不同于固定的PCA,我们提出可学习的压缩,使用FiLM(特征加权线性调节)条件,其中任务特定的嵌入式信息调节压缩,以保留每个任务分布的判别性特征;2. 空间多样的示例选择:传统采样忽略了对检测至关重要的空间信息——我们通过在IoU空间中使用最远点采样选择示例,以最大化边界框的多样性,防止回放中的定位偏差;3. 可部署的MCU系统:我们的潜在回放存储每个样本150字节,而图像存储则超过10KB,使64KB缓冲区能够容纳400多个示例。在CORe50(50个类别,5个任务)上的实验表明,LRD在初始任务上实现了mAP@50,并在后续任务中保持了强大的性能——这比朴素微调有显著改进,同时在严格的MCU约束下运行。我们的任务自适应FiLM压缩和空间多样的示例选择协同工作,以保留检测能力。部署在STM32H753ZI、ESP32-S3和MAX78000 MCUs上,LRD在64KB内存预算内实现了4.9-97.5毫秒的每推理延迟,使在边缘设备上实现持续检测成为可能。

英文摘要:

Deploying object detection on microcontrollers (MCUs) enables intelligent edge devices but current models cannot learn new object categories after deployment. Existing continual learning methods require storing raw images far exceeding MCU memory budgets of tens of kilobytes. We present Latent Replay Detection (LRD), the first framework for continual object detection under MCU memory constraints. Our key contributions are: 1. Task-Adaptive Compression: Unlike fixed PCA, we propose learnable compression with FiLM (Feature-wise Linear Modulation) conditioning, where task specific embeddings modulate the compression to preserve discriminative features for each task's distribution; 2. Spatial-Diverse Exemplar Selection: Traditional sampling ignores spatial information critical for detection - we select exemplars maximizing bounding box diversity via farthest-point sampling in IoU space, preventing localization bias in replay; 3. MCU-Deployable System: Our latent replay stores 150 bytes per sample versus >10KB for images, enabling a 64KB buffer to hold 400+ exemplars. Experiments on CORe50 (50 classes, 5 tasks) demonstrate that LRD achieves mAP@50 on the initial task and maintains strong performance across subsequent tasks - a significant improvement over naive fine-tuning while operating within strict MCU constraints. Our task-adaptive FiLM compression and spatial diverse exemplar selection work synergistically to preserve detection capabilities. Deployed on STM32H753ZI, ESP32-S3, and MAX78000 MCUs, LRD achieves 4.9-97.5ms latency per inference within a 64KB memory budget-enabling practical continual detection on edge devices for the first time.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑