arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2510.08925cs.CV

通过特征空间扰动防御图像恢复中的未授权蒸馏

Defense against Unauthorized Distillation in Image Restoration via Feature Space Perturbation

Shandong Normal University(山东师范大学);Sun Yat-sen University(中山大学)

Han Hu, Zhuoran Zheng, Chen Lyu

AI总结:

针对图像恢复模型未授权蒸馏攻击,提出运行时防御方法ASVP,通过SVD放大特征图前k个奇异值注入高频扰动破坏蒸馏对齐,在不影响教师性能前提下显著降低学生模型指标。

摘要:

知识蒸馏(KD)攻击允许对手利用教师模型的输出来训练学生网络,对深度模型的知识产权构成了重大威胁。尽管图像分类领域近期的防御方法已通过扰动输出概率成功破坏了KD,但将这些方法扩展至图像恢复却十分困难。与分类不同,恢复是一项生成任务,其输出连续且高维,依赖于空间连贯性和精细细节。微小的扰动往往不够,因为学生模型仍能学习到潜在的映射。为解决此问题,我们提出了自适应奇异值扰动(ASVP),这是一种专为图像恢复模型定制的运行时防御方法。ASVP利用奇异值分解(SVD)作用于教师模型的内部特征图。它放大前k个奇异值以注入结构化的高频扰动,从而破坏蒸馏所需的对齐。这阻碍了学生的学习,同时保持了教师模型的输出质量。我们在五个图像恢复任务上评估了ASVP:超分辨率、低照度增强、水下增强、去雾和去雨。实验表明,ASVP使学生模型的PSNR最多降低4 dB,SSIM降低60-75%,且对教师模型的性能影响微乎其微。与先前方法相比,ASVP提供了更强且更一致的防御。我们的方法为保护开源恢复模型免受未授权知识蒸馏提供了实用方案。

英文摘要:

Knowledge distillation (KD) attacks pose a significant threat to deep model intellectual property by enabling adversaries to train student networks using a teacher model's outputs. While recent defenses in image classification have successfully disrupted KD by perturbing output probabilities, extending these methods to image restoration is difficult. Unlike classification, restoration is a generative task with continuous, high-dimensional outputs that depend on spatial coherence and fine details. Minor perturbations are often insufficient, as students can still learn the underlying mapping.To address this, we propose Adaptive Singular Value Perturbation (ASVP), a runtime defense tailored for image restoration models. ASVP operates on internal feature maps of the teacher using singular value decomposition (SVD). It amplifies the topk singular values to inject structured, high-frequency perturbations, disrupting the alignment needed for distillation. This hinders student learning while preserving the teacher's output quality.We evaluate ASVP across five image restoration tasks: super-resolution, low-light enhancement, underwater enhancement, dehazing, and deraining. Experiments show ASVP reduces student PSNR by up to 4 dB and SSIM by 60-75%, with negligible impact on the teacher's performance. Compared to prior methods, ASVP offers a stronger and more consistent defense.Our approach provides a practical solution to protect open-source restoration models from unauthorized knowledge distillation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑