arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2502.17872cs.LGcs.AI

对比学习与恶意噪声

Contrastive Learning with Nasty Noise

Ziruo Zhao

AI总结:

本文分析恶意噪声下对比学习的理论极限,利用PAC学习和VC维建立样本复杂性上下界,并推导基于l2距离的数据依赖界。

摘要:

对比学习已成为自监督表示学习的一种强大范式。本文分析了在恶意噪声下对比学习的理论极限,其中对手会修改或替换训练样本。利用PAC学习和VC维分析,建立了对抗设置下样本复杂性的下界和上界。此外,还推导了基于l2距离函数的数据依赖的样本复杂性界。

英文摘要:

Contrastive learning has emerged as a powerful paradigm for self-supervised representation learning. This work analyzes the theoretical limits of contrastive learning under nasty noise, where an adversary modifies or replaces training samples. Using PAC learning and VC-dimension analysis, lower and upper bounds on sample complexity in adversarial settings are established. Additionally, data-dependent sample complexity bounds based on the l2-distance function are derived.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑