arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2201.03803cs.CV
收藏

基于局部增强和原型字典学习的无监督领域自适应人物识别

Unsupervised Domain Adaptive Person Re-id with Local-enhance and Prototype Dictionary Learning

Haopeng Hou

摘要:

无监督域自适应人员重新识别(re-ID)任务一直是一个挑战,因为与一般的域自适应任务不同,在人员重新识别中,源和目标域数据的类之间没有重叠,这导致了显著的域间隙。最先进的无监督re-ID方法使用基于记忆的对比损失训练神经网络。然而,将每个未标记的实例作为一个类来进行对比学习,会导致类冲突问题,并且在存储体中更新时,由于不同类别的实例数量不同,导致更新强度不一致。为了解决这些问题,我们提出了原型字典学习的人重新识别,这是能够利用源域数据和目标域数据的一个训练阶段,同时避免类冲突的问题和更新强度不一致的问题,集群级原型字典学习。为了减少域间隙对模型的干扰,在不增加模型参数的情况下,提出了局部增强模块,提高了模型的领域自适应能力。我们在两个大型数据集上的实验证明了原型字典学习的有效性。在Market-to-Duke任务中实现了71.5\%的mAP,与最先进的无监督域自适应re-ID方法相比提高了2.3\%。它在Duke-to-Market任务中实现了83.9mAP,与最先进的无监督自适应re-ID方法相比提高了4.4%。

英文摘要:

The unsupervised domain adaptive person re-identification (re-ID) task has been a challenge because, unlike the general domain adaptive tasks, there is no overlap between the classes of source and target domain data in the person re-ID, which leads to a significant domain gap. State-of-the-art unsupervised re-ID methods train the neural networks using a memory-based contrastive loss. However, performing contrastive learning by treating each unlabeled instance as a class will lead to the problem of class collision, and the updating intensity is inconsistent due to the difference in the number of instances of different categories when updating in the memory bank. To address such problems, we propose Prototype Dictionary Learning for person re-ID which is able to utilize both source domain data and target domain data by one training stage while avoiding the problem of class collision and the problem of updating intensity inconsistency by cluster-level prototype dictionary learning. In order to reduce the interference of domain gap on the model, we propose a local-enhance module to improve the domain adaptation of the model without increasing the number of model parameters. Our experiments on two large datasets demonstrate the effectiveness of the prototype dictionary learning. 71.5\% mAP is achieved in the Market-to-Duke task, which is a 2.3\% improvement compared to the state-of-the-art unsupervised domain adaptive re-ID methods. It achieves 83.9\% mAP in the Duke-to-Market task, which improves by 4.4\% compared to the state-of-the-art unsupervised adaptive re-ID methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑