arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1802.03170cs.LGstat.ML
收藏

对抗性度量学习

Adversarial Metric Learning

Nanjing University of Science and Technology(南京理工大学);Northeastern University(东北大学);Department of Electrical and Computer Engineering, Northeastern University(东北大学电气与计算机工程系)

Shuo Chen, Chen Gong, Jian Yang, Xiang Li, Yang Wei, Jun Li

摘要:

在过去的几十年里,人们一直致力于为度量学习问题设计各种损失函数和度量形式。当测试数据与训练数据相似时,这些改进已经显示出有希望的结果。然而,由于训练集和测试集之间的分布偏差,训练后的模型往往不能在模糊测试对上产生可靠的距离。为了解决这个问题,本文提出了对抗度量学习(AML),它自动生成对抗对,以弥补分布偏差,促进鲁棒的度量学习。具体而言,AML包括两个对抗阶段,即混淆和混淆。在混淆阶段,自适应地产生模糊但关键的对抗数据对,以误导学习的度量。在训练阶段,一个度量是穷尽学习,以尽量区分敌对对和原始训练对。由于这种竞争过程中混淆阶段所带来的挑战,AML模型能够掌握原始训练对所不包含的大量困难知识,因此AML的可区分性可以显着提高。将整个模型转化为优化框架,并从理论上证明了优化框架的全局收敛性。在玩具数据和实际数据集上的实验结果清楚地证明了AML的优越性,以代表国家的最先进的度量学习方法。

英文摘要:

In the past decades, intensive efforts have been put to design various loss functions and metric forms for metric learning problem. These improvements have shown promising results when the test data is similar to the training data. However, the trained models often fail to produce reliable distances on the ambiguous test pairs due to the distribution bias between training set and test set. To address this problem, the Adversarial Metric Learning (AML) is proposed in this paper, which automatically generates adversarial pairs to remedy the distribution bias and facilitate robust metric learning. Specifically, AML consists of two adversarial stages, i.e. confusion and distinguishment. In confusion stage, the ambiguous but critical adversarial data pairs are adaptively generated to mislead the learned metric. In distinguishment stage, a metric is exhaustively learned to try its best to distinguish both the adversarial pairs and the original training pairs. Thanks to the challenges posed by the confusion stage in such competing process, the AML model is able to grasp plentiful difficult knowledge that has not been contained by the original training pairs, so the discriminability of AML can be significantly improved. The entire model is formulated into optimization framework, of which the global convergence is theoretically proved. The experimental results on toy data and practical datasets clearly demonstrate the superiority of AML to the representative state-of-the-art metric learning methodologies.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑