arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2512.16164cs.CVcs.AI

面向类别的双对齐生成提示适应:C-DGPA

C-DGPA: Class-Centric Dual-Alignment Generative Prompt Adaptation

Chao Li, Dasha Hu, Chengyang Li, Yuming Jiang, Yuncheng Shen

更新

AI总结:

C-DGPA通过双分支架构协同优化边缘分布和条件分布对齐,提升无监督领域适应中提示学习的领域不变性和语义判别性。

AI中文摘要:

无监督领域适应将知识从标记源领域转移到未标记的目标领域。直接在下游UDA任务中部署视觉-语言模型(VLMs)并进行提示微调面临缓解领域差异的重大挑战。现有的提示微调策略主要对边缘分布进行对齐,但忽视了条件分布差异,导致诸如类原型错位和语义判别性下降等关键问题。为了解决这些限制,本文提出了C-DGPA:面向类别的双对齐生成提示适应。C-DGPA通过一种新颖的双分支架构协同优化边缘分布对齐和条件分布对齐。边缘分布对齐分支采用动态对抗训练框架来弥合边缘分布差异。同时,条件分布对齐分支引入了类映射机制(CMM)通过标准化语义提示理解和防止源领域过度依赖来对齐条件分布差异。这种双对齐策略通过协同优化有效地将领域知识整合到提示学习中,确保领域不变和语义判别性的表示。在OfficeHome、Office31和VisDA-2017上进行了广泛的实验验证了C-DGPA的优越性。它在所有基准上实现了新的最先进的结果。

英文摘要:

Unsupervised Domain Adaptation transfers knowledge from a labeled source domain to an unlabeled target domain. Directly deploying Vision-Language Models (VLMs) with prompt tuning in downstream UDA tasks faces the signifi cant challenge of mitigating domain discrepancies. Existing prompt-tuning strategies primarily align marginal distribu tion, but neglect conditional distribution discrepancies, lead ing to critical issues such as class prototype misalignment and degraded semantic discriminability. To address these lim itations, the work proposes C-DGPA: Class-Centric Dual Alignment Generative Prompt Adaptation. C-DGPA syner gistically optimizes marginal distribution alignment and con ditional distribution alignment through a novel dual-branch architecture. The marginal distribution alignment branch em ploys a dynamic adversarial training framework to bridge marginal distribution discrepancies. Simultaneously, the con ditional distribution alignment branch introduces a Class Mapping Mechanism (CMM) to align conditional distribu tion discrepancies by standardizing semantic prompt under standing and preventing source domain over-reliance. This dual alignment strategy effectively integrates domain knowl edge into prompt learning via synergistic optimization, ensur ing domain-invariant and semantically discriminative repre sentations. Extensive experiments on OfficeHome, Office31, and VisDA-2017 validate the superiority of C-DGPA. It achieves new state-of-the-art results on all benchmarks.

↑