arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.06313cs.CV

WMoE-CLIP:小波增强的专家混合提示学习用于零样本异常检测

WMoE-CLIP: Wavelet-Enhanced Mixture-of-Experts Prompt Learning for Zero-Shot Anomaly Detection

School of Cyber Science and Technology, Shenzhen Campus of Sun Yat-sen University, Shenzhen(中山大学深圳校区计算机科学与技术学院)

Peng Chen, Chao Huang

AI总结:

本文提出WMoE-CLIP方法,通过小波分解提取多频图像特征并结合变分自编码器提升提示适应性,引入语义感知的专家混合模块,有效提升零样本异常检测性能。

摘要:

视觉-语言模型最近在零样本异常检测(ZSAD)中展现出强大的泛化能力,能够检测未见过的异常而无需任务特定监督。然而,现有方法通常依赖固定文本提示,难以捕捉复杂语义,并仅关注空间域特征,限制了检测细微异常的能力。为此,我们提出了一种小波增强的专家混合提示学习方法用于ZSAD。具体而言,变分自编码器用于建模全局语义表示并将其整合到提示中以增强对多样化异常模式的适应性。小波分解提取多频图像特征,通过跨模态交互动态细化文本嵌入。此外,引入了语义感知的专家混合模块以聚合上下文信息。在14个工业和医疗数据集上的广泛实验验证了所提方法的有效性。

英文摘要:

Vision-language models have recently shown strong generalization in zero-shot anomaly detection (ZSAD), enabling the detection of unseen anomalies without task-specific supervision. However, existing approaches typically rely on fixed textual prompts, which struggle to capture complex semantics, and focus solely on spatial-domain features, limiting their ability to detect subtle anomalies. To address these challenges, we propose a wavelet-enhanced mixture-of-experts prompt learning method for ZSAD. Specifically, a variational autoencoder is employed to model global semantic representations and integrate them into prompts to enhance adaptability to diverse anomaly patterns. Wavelet decomposition extracts multi-frequency image features that dynamically refine textual embeddings through cross-modal interactions. Furthermore, a semantic-aware mixture-of-experts module is introduced to aggregate contextual information. Extensive experiments on 14 industrial and medical datasets demonstrate the effectiveness of the proposed method.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑