arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2607.02930cs.CV

CL-Anomaly:用于异常检测中持续学习的具有多模态大语言模型的层自适应专家混合模型

CL-Anomaly: Layer-Adaptive Mixture-of-Experts with Multimodal Large Language Model for Continual Learning in Anomaly Detection

Nanjing University(南京大学);China Mobile Zijin Innovation Institute(中国移动紫金创新研究院);Nanjing University of Science and Technology(南京理工大学)

Wen Dong, Zhao Wang, Shuangqing Zhang, Kai Sun, Ben Li, Guo-Sen Xie, Caifeng Shan, Fang Zhao

AI总结:

针对多模态大语言模型持续学习计算昂贵及现有方法语义纠缠问题,提出CL-Anomaly框架,用隔离共享协作实现参数高效微调,介绍任务私有专家PrivLoRA等,实验表明其性能优于现有方法。

摘要:

多模态大语言模型在各种视觉任务中表现出色,但随着现实世界知识的发展,全参数重新训练在计算上成本高昂。现有持续学习方法在跨任务的参数空间中常存在语义纠缠,阻碍模型的持续部署。在异常检测中这一挑战尤为突出。本文提出CL-Anomaly,一种基于隔离-共享协作的参数高效微调框架,用于多模态大语言模型的异常检测持续学习。我们引入任务私有专家PrivLoRA,在参数空间中物理隔离特定任务子空间,防止异常知识在不同场景下的语义纠缠。层自适应共享专家在统一特征空间内维护跨任务表示,实现新旧任务间的知识共享。此外,我们提出一种层自适应知识转移策略,通过基于动量的机制自动选择并动态更新每个任务的层级关键共享专家,促进相关异常检测任务间的有效知识转移。在异常检测的三种持续学习场景(包括类增量、跨域和跨模态)上的广泛实验表明,CL-Anomaly优于现有方法。代码可在这个https网址获取。

英文摘要:

Multimodal Large Language Models (MLLMs) excel in diverse vision tasks, but full-parameter retraining is computationally expensive as real-world knowledge evolves. Existing continual learning methods often suffer from semantic entanglement in parameter spaces across tasks, impeding the continuous deployment of models. This challenge is especially pronounced in Anomaly Detection (AD), which exhibits triple heterogeneity across modalities, domains, and defect scale variability, significantly complicating multi-task knowledge transfer. In this paper, we propose CL-Anomaly, a parameter-efficient fine-tuning framework based on an isolation-sharing collaboration to enable continual learning for anomaly detection with MLLMs. We introduce the task-private expert PrivLoRA, which physically isolates task-specific subspaces in the parameter space to prevent semantic entanglement of anomaly knowledge in diverse scenarios. The Layer-Adaptive Shared Experts maintain cross-task representations within a unified feature space, enabling knowledge sharing between previous and new tasks. Furthermore, we propose a Layer-Adaptive Knowledge Transfer strategy that automatically selects and dynamically updates the layer-wise key shared experts of each task via a momentum-based mechanism, promoting effective knowledge transfer across related anomaly detection tasks. Extensive experiments across three continual learning scenarios for anomaly detection, including class-incremental, cross-domain, and cross-modal, demonstrate that CL-Anomaly outperforms state-of-the-art methods. Code is available at https://github.com/WenDongyp/CL-Anomaly.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑