arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.00446cs.CVcs.AI
收藏

借助长期特征库推进超越分类任务的有监督局部学习

Advancing Supervised Local Learning Beyond Classification with Long-term Feature Bank

Feiyu Zhu, Yuming Zhang, Xiuyuan Guo, Hengyu Shi, Junfeng Luo, Junhao Su, Jialin Gao

AI总结:

针对局部学习难以拓展至分类外视觉任务的问题,提出融入特征库的FBA架构,实现局部学习在多视觉任务上的首次成功应用,兼顾显存节省与端到端级性能。

摘要:

局部学习为深度神经网络中传统的端到端反向传播提供了替代方案,可显著降低GPU内存消耗。尽管它在图像分类任务中已展现出潜力,但向其他视觉任务的拓展仍受到限制。这一局限主要源于两个因素:1)专为分类设计的架构难以适配其他任务,导致无法有效复用针对不同问题定制的架构中的任务特定知识;2)这些聚焦分类的架构通常缺乏跨尺度特征通信,致使目标检测和超分辨率等任务的性能下降。为应对这些挑战,我们提出了特征库增强辅助网络(Feature Bank Augmented auxiliary network, FBA),该方法引入了简化的设计原则,并融入特征库以提升跨任务适配性与特征通信能力。这项工作是局部学习方法首次成功应用于分类以外的领域,证明FBA不仅能节省GPU内存,还能在多种视觉任务的多个数据集上达到与端到端方法相当的性能。

英文摘要:

Local learning offers an alternative to traditional end-to-end back-propagation in deep neural networks, significantly reducing GPU memory consumption. Although it has shown promise in image classification tasks, its extension to other visual tasks has been limited. This limitation arises primarily from two factors: 1) architectures designed specifically for classification are not readily adaptable to other tasks, which prevents the effective reuse of task-specific knowledge from architectures tailored to different problems; 2) these classification-focused architectures typically lack cross-scale feature communication, leading to degraded performance in tasks like object detection and super-resolution. To address these challenges, we propose the Feature Bank Augmented auxiliary network (FBA), which introduces a simplified design principle and incorporates a feature bank to enhance cross-task adaptability and communication. This work represents the first successful application of local learning methods beyond classification, demonstrating that FBA not only conserves GPU memory but also achieves performance on par with end-to-end approaches across multiple datasets for various visual tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑