arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2409.05277cs.CVcs.AI

面向短期与长期行人重识别的解耦表示

Disentangled Representations for Short-Term and Long-Term Person Re-Identification

Yonsei University(延世大学)

Chanho Eom, Wonkyung Lee, Geon Lee, Bumsub Ham

AI总结:

本文提出 IS-GAN,仅用身份标签将行人特征解耦为身份相关与无关因素,在短期及长期 reID 多个基准上取得最先进结果。

摘要:

我们研究行人重识别(reID)问题,即在给定感兴趣行人的查询图像时,从大型数据集中检索该行人的图像。一个关键挑战是学习对类内变化具有鲁棒性的行人表示,因为不同行人可能具有相同属性,而行人的外观也可能看起来不同,例如随视角变化。近期的 reID 方法侧重于学习仅对某一特定变化因素(如人体姿态)具有判别力的行人特征,这还需要相应的监督信号(如姿态标注)。为解决这一问题,我们建议将行人图像分解为与身份相关和与身份无关的特征。与身份相关的特征包含用于确定特定行人的有用信息(如衣物),而与身份无关的特征则包含其他因素(如人体姿态)。为此,我们提出一种新的生成对抗网络,称为 identity shuffle GAN(IS-GAN)。它通过身份混洗技术从行人图像中解耦与身份相关和无关的特征,该技术仅利用身份标签,而不需要任何辅助监督信号。我们约束与身份无关特征的分布,或鼓励与身份相关和无关特征互不相关,从而促进解耦过程。实验结果验证了 IS-GAN 的有效性,表明其在 Market-1501、CUHK03 和 DukeMTMC-reID 等标准 reID 基准上达到最先进性能。我们进一步证明了解耦行人表示在长期 reID 任务上的优势,并在 Celeb-reID 数据集上确立了新的最先进水平。

英文摘要:

We address the problem of person re-identification (reID), that is, retrieving person images from a large dataset, given a query image of the person of interest. A key challenge is to learn person representations robust to intra-class variations, as different persons could have the same attribute, and persons' appearances look different, e.g., with viewpoint changes. Recent reID methods focus on learning person features discriminative only for a particular factor of variations (e.g., human pose), which also requires corresponding supervisory signals (e.g., pose annotations). To tackle this problem, we propose to factorize person images into identity-related and unrelated features. Identity-related features contain information useful for specifying a particular person (e.g., clothing), while identity-unrelated ones hold other factors (e.g., human pose). To this end, we propose a new generative adversarial network, dubbed identity shuffle GAN (IS-GAN). It disentangles identity-related and unrelated features from person images through an identity-shuffling technique that exploits identification labels alone without any auxiliary supervisory signals. We restrict the distribution of identity-unrelated features or encourage the identity-related and unrelated features to be uncorrelated, facilitating the disentanglement process. Experimental results validate the effectiveness of IS-GAN, showing state-of-the-art performance on standard reID benchmarks, including Market-1501, CUHK03, and DukeMTMC-reID. We further demonstrate the advantages of disentangling person representations on a long-term reID task, setting a new state of the art on a Celeb-reID dataset.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑