arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.02637cs.CV
收藏

BSDP:面向在线开放世界目标检测的脑启发流式双层扰动方法

BSDP: Brain-inspired Streaming Dual-level Perturbations for Online Open World Object Detection

School of Computer Engineering and Science, Shanghai University(上海大学计算机工程与科学学院);Institute of Artificial Intelligence, Shanghai University(上海大学人工智能研究院);Department of Computer and Information Technology, Beijing Jiaotong University(北京交通大学计算机与信息技术学院)

Yu Chen, Liyan Ma, Liping Jing, Jian Yu

AI总结:

针对在线开放世界目标检测问题,提出脑启发流式双层扰动方法BSDP,通过原型样本回放、特征级与数据级流式扰动,实现模型学习新知识且不遗忘旧知识,在公开数据集上取得优异性能。

摘要:

人类能够轻松区分已知类别和未知类别,并且可以通过单次学习识别未知物体,无需反复学习,同时不会遗忘已经学过的物体。因此,我们旨在让深度学习模型模拟人类的学习方式,我们将这种学习模式称为在线开放世界目标检测(OnLine Open World Object Detection, OLOWOD)。现有的开放世界目标检测(OWOD)方法更多关注未知类别的识别,而增量学习部分同样十分重要。此外,一些神经科学研究表明,特定的噪声能够促使大脑形成新的连接和神经通路,这可能提升学习的速度和效率。在本文中,我们将旧样本的双层信息作为施加在新样本上的扰动,使模型既能擅长学习新知识,又不会遗忘旧知识。据此,我们提出了一种简单的即插即用方法,名为脑启发流式双层扰动(Brain-inspired Streaming Dual-level Perturbations, BSDP),用于解决OLOWOD问题。具体而言:(1)我们首先计算先前类别的原型,利用样本与原型之间的距离作为样本选择策略,挑选旧样本用于回放;(2)随后将这些原型作为新样本的流式特征级扰动,通过重温旧知识来提升模型的可塑性;(3)同时利用旧类别样本的特征分布,以流的形式生成对抗数据作为数据级扰动,增强模型对新类别的鲁棒性。我们在PASCAL VOC和MS-COCO数据集上对BSDP进行了实验评估,优异的结果证明了我们所提出的方法和学习模式具备可观的性能。

英文摘要:

Humans can easily distinguish the known and unknown categories and can recognize the unknown object by learning it once instead of repeating it many times without forgetting the learned object. Hence, we aim to make deep learning models simulate the way people learn. We refer to such a learning manner as OnLine Open World Object Detection(OLOWOD). Existing OWOD approaches pay more attention to the identification of unknown categories, while the incremental learning part is also very important. Besides, some neuroscience research shows that specific noises allow the brain to form new connections and neural pathways which may improve learning speed and efficiency. In this paper, we take the dual-level information of old samples as perturbations on new samples to make the model good at learning new knowledge without forgetting the old knowledge. Therefore, we propose a simple plug-and-play method, called Brain-inspired Streaming Dual-level Perturbations(BSDP), to solve the OLOWOD problem. Specifically, (1) we first calculate the prototypes of previous categories and use the distance between samples and the prototypes as the sample selecting strategy to choose old samples for replay; (2) then take the prototypes as the streaming feature-level perturbations of new samples, so as to improve the plasticity of the model through revisiting the old knowledge; (3) and also use the distribution of the features of the old category samples to generate adversarial data in the form of streams as the data-level perturbations to enhance the robustness of the model to new categories. We empirically evaluate BSDP on PASCAL VOC and MS-COCO, and the excellent results demonstrate the promising performance of our proposed method and learning manner.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑