arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.11804cs.CVeess.IV

基于深度感知融合与有限训练数据的高效分割一切

Efficient Segment Anything with Depth-Aware Fusion and Limited Training Data

University of Cambridge(剑桥大学)

Yiming Zhou, Xuenjie Xie, Panfeng Li, Albrecht Kunz, Ahmad Osman, Xavier Maldague

AI总结:

提出一种轻量级RGB-D融合框架,通过单目深度先验增强EfficientViT-SAM,在仅使用11.2k训练样本(不到SA-1B的0.1%)的情况下,实现比EfficientViT-SAM更高的分割精度。

摘要:

分割一切模型(SAM)实现了令人印象深刻的通用分割性能,但需要大规模数据集(例如1100万张图像)且仅依赖RGB输入。最近的高效变体减少了计算量,但仍依赖于大规模训练。我们提出了一种轻量级RGB-D融合框架,用单目深度先验增强EfficientViT-SAM。深度图通过预训练的估计器生成,并通过专门的深度编码器与RGB特征进行中层融合。仅使用11.2k样本(不到SA-1B的0.1%)训练,我们的方法比EfficientViT-SAM取得了更高的准确率,表明深度线索为分割提供了强大的几何先验。

英文摘要:

Segment Anything Models (SAM) achieve impressive universal segmentation performance but require massive datasets (e.g., 11M images) and rely solely on RGB inputs. Recent efficient variants reduce computation but still depend on large-scale training. We propose a lightweight RGB-D fusion framework that augments EfficientViT-SAM with monocular depth priors. Depth maps are generated with a pretrained estimator and fused mid-level with RGB features through a dedicated depth encoder. Trained on only 11.2k samples (less than 0.1\% of SA-1B), our method achieves higher accuracy than EfficientViT-SAM, showing that depth cues provide strong geometric priors for segmentation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑