arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2607.04711cs.CV
收藏

学习用于持续学习的概率提示

Learning Probabilistic Prompt for Continual Learning

Yonsei University(延世大学);Samsung Electronics(三星电子)

Hyekang Park, Sanghoon Lee, Geon Lee, Jongyoun Noh, Bumsub Ham

AI总结:

研究持续学习中从序列任务渐进学习并保留旧知识的问题,提出基于概率分布建模提示并构建混合分布采样多样提示的框架,还设正则化损失,实验验证框架有效性。

摘要:

持续学习旨在从一系列任务中逐步学习,每个任务包含不相交的类别子集,同时保留先前学到的知识。基于提示的持续学习方法通过将少量参数(即提示)与输入图像的查询特征相关联来学习。然而,现有基于提示的方法存在提示坍塌问题。为解决此问题,我们提出了一种新颖的基于提示的持续学习框架,该框架跨任务序列捕获图像的不同模式。为此,我们将每个提示建模为概率分布,并构建这些分布的混合,从中采样不同的提示。这使我们的模型能够在持续学习过程中有效捕获高度不同的图像分布。我们还提出了一种分布正则化损失,以防止在整个训练过程中提示分布的突然变化。我们展示了在标准基准上进行持续学习的广泛实验结果,包括ImageNet-R、CIFAR-100和CUB-200,证明了我们框架的有效性。

英文摘要:

Continual learning aims to progressively learn from a sequence of tasks, each containing a disjoint subset of classes, while preserving previously learned knowledge. Prompt-based continual learning methods propose to learn a small set of parameters, i.e., prompts, by associating them with a query feature of an input image. These methods optimize the prompts, attempting to represent diverse patterns of images. However, we have observed that existing prompt-based methods suffer from a prompt collapse problem, that is, the prompts tend to be highly similar to each other, thereby failing to capture the diverse data distributions in continual learning scenarios. To address this issue, we propose in this paper a novel prompt-based continual learning framework that captures diverse patterns of images across a sequence of tasks. To this end, we model each prompt as a probabilistic distribution and construct a mixture of these distributions, from which we sample diverse prompts. This enables our model to effectively capture highly diverse image distributions in the continual learning process. We also present a distribution regularization loss to prevent abrupt changes in the prompt distributions throughout the training process. We show extensive experimental results for continual learning on standard benchmarks, including ImageNet-R, CIFAR-100, and CUB-200, demonstrating the effectiveness of our framework.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑