Current training objectives of existing person Re-IDentification (ReID) models only ensure that the loss of the model decreases on selected training batch, with no regards to the performance on samples outside the batch. It will inevitably cause the model to over-fit the data in the dominant position (e.g., head data in imbalanced class, easy samples or noisy samples). %We call the sample that updates the model towards generalizing on more data a generalizable sample. The latest resampling methods address the issue by designing specific criterion to select specific samples that trains the model generalize more on certain type of data (e.g., hard samples, tail data), which is not adaptive to the inconsistent real world ReID data distributions. Therefore, instead of simply presuming on what samples are generalizable, this paper proposes a one-for-more training objective that directly takes the generalization ability of selected samples as a loss function and learn a sampler to automatically select generalizable samples. More importantly, our proposed one-for-more based sampler can be seamlessly integrated into the ReID training framework which is able to simultaneously train ReID models and the sampler in an end-to-end fashion. The experimental results show that our method can effectively improve the ReID model training and boost the performance of ReID models.
Texas A&M University（德州农工大学）；Walmart Technology（沃尔玛科技）；Wormpex AI Research（Wormpex人工智能研究院）
Many real-world applications, such as city-scale traffic monitoring and control, requires large-scale re-identification. However, previous ReID methods often failed to address two limitations in existing ReID benchmarks, i.e., low spatiotemporal coverage and sample imbalance. Notwithstanding their demonstrated success in every single benchmark, they have difficulties in generalizing to unseen environments. As a result, these methods are less applicable in a large-scale setting due to poor generalization. In seek for a highly generalizable large-scale ReID method, we present an adversarial doma…
Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所）；School of Artificial Intelligence, University of Chinese Academy of Sciences（中国科学院大学人工智能学院）；University of Chinese Academy of Sciences（中国科学院大学）
Generalizable person Re-Identification (ReID) has attracted growing attention in recent computer vision community. In this work, we construct a structural causal model among identity labels, identity-specific factors (clothes/shoes color etc), and domain-specific factors (background, viewpoints etc). According to the causal analysis, we propose a novel Domain Invariant Representation Learning for generalizable person Re-Identification (DIR-ReID) framework. Specifically, we first propose to disentangle the identity-specific and domain-specific feature spaces, based on which we propose an effect…
University of Chinese Academy of Sciences（中国科学院大学）；Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所）；Longfor Inc.（龙湖集团）
Domain generalizable (DG) person re-identification (ReID) aims to test across unseen domains without access to the target domain data at training time, which is a realistic but challenging problem. In contrast to methods assuming an identical model for different domains, Mixture of Experts (MoE) exploits multiple domain-specific networks for leveraging complementary information between domains, obtaining impressive results. However, prior MoE-based DG ReID methods suffer from a large model size with the increase of the number of source domains, and most of them overlook the exploitation of dom…
AIDA-ReID: Adaptive Intermediate Domain Adaptation for Generalizable and Source-Free Person Re-Identification
School of Software, Nanjing University of Information Science and Technology（信息科学技术大学软件学院）；Wuxi Institute of Technology, Nanjing University of Information Science and Technology（信息科学技术大学无锡研究院）；School of Computer Science, Wuhan University（武汉大学计算机学院）；School of Computer and Information Science, Southwest University（西南大学计算机学院）；School of Big Data and Computer Science, Guizhou Normal University（贵州师范大学大数据与计算机科学学院）
University of Science and Technology of China（中国科学技术大学）；Microsoft Research Asia（微软亚洲研究院）；University of Oxford（牛津大学）
Existing fully-supervised person re-identification (ReID) methods usually suffer from poor generalization capability caused by domain gaps. The key to solving this problem lies in filtering out identity-irrelevant interference and learning domain-invariant person representations. In this paper, we aim to design a generalizable person ReID framework which trains a model on source domains yet is able to generalize/perform well on target domains. To achieve this goal, we propose a simple yet effective Style Normalization and Restitution (SNR) module. Specifically, we filter out style variations (…
Recently, due to the poor performance of supervised person re-identification (ReID) to an unseen domain, Domain Generalization (DG) person ReID has attracted a lot of attention which aims to learn a domain-insensitive model and can resist the influence of domain bias. In this paper, we first verify through an experiment that style factors are a vital part of domain bias. Base on this conclusion, we propose a Style Variable and Irrelevant Learning (SVIL) method to eliminate the effect of style factors on the model. Specifically, we design a Style Jitter Module (SJM) in SVIL. The SJM module can …
Mohamed bin Zayed University of Artificial Intelligence（穆罕默德·本·扎耶德人工智能大学）
Recent studies show that models trained on synthetic datasets are able to achieve better generalizable person re-identification (GPReID) performance than that trained on public real-world datasets. On the other hand, due to the limitations of real-world person ReID datasets, it would also be important and interesting to use large-scale synthetic datasets as test sets to benchmark person ReID algorithms. Yet this raises a critical question: is synthetic dataset reliable for benchmarking generalizable person re-identification? In the literature there is no evidence showing this. To address this,…
Northwestern Polytechnical University（西北工业大学）；Ningbo Institute, Northwestern Polytechnical University（西北工业大学宁波研究院）；Nanyang Technological University（南洋理工大学）；The University of Adelaide（阿德莱德大学）
In the current person Re-identification (ReID) methods, most domain generalization works focus on dealing with style differences between domains while largely ignoring unpredictable camera view change, which we identify as another major factor leading to a poor generalization of ReID methods. To tackle the viewpoint change, this work proposes to use a 3D dense pose estimation model and a texture mapping module to map the pedestrian images to canonical view images. Due to the imperfection of the texture mapping module, the canonical view images may lose the discriminative detail clues from the …
Find Them All: Unveiling MLLMs for Versatile Person Re-identification
School of Computer Science and Technology, East China Normal University（东华大学计算机科学与技术学院）；Institute of Image Communication and Information Processing, Shanghai Jiao Tong University（上海交通大学图像通信与信息处理研究所）；Macao Polytechnic University（澳门 polytechnic 大学）；Shanghai AI Laboratory（上海人工智能实验室）
Peking University（北京大学）；Singapore University of Technology and Design（新加坡科技设计大学）；National University of Singapore（新加坡国立大学）；Peng Cheng Laboratory（鹏城实验室）
Domain generalizable (DG) person re-identification (ReID) is a challenging problem because we cannot access any unseen target domain data during training. Almost all the existing DG ReID methods follow the same pipeline where they use a hybrid dataset from multiple source domains for training, and then directly apply the trained model to the unseen target domains for testing. These methods often neglect individual source domains' discriminative characteristics and their relevances w.r.t. the unseen target domains, though both of which can be leveraged to help the model's generalization. To han…
Beijing Jiaotong University（北京交通大学）；University of Edinburgh（爱丁堡大学）
Contemporary person re-identification (\reid) methods usually require access to data from the deployment camera network during training in order to perform well. This is because contemporary \reid{} models trained on one dataset do not generalise to other camera networks due to the domain-shift between datasets. This requirement is often the bottleneck for deploying \reid{} systems in practical security or commercial applications, as it may be impossible to collect this data in advance or prohibitively costly to annotate it. This paper alleviates this issue by proposing a simple baseline for d…
Xiamen University（厦门大学）；University of Trento（特伦托大学）；Minnan Normal University（闽南师范大学）
Recent advances in person re-identification (ReID) obtain impressive accuracy in the supervised and unsupervised learning settings. However, most of the existing methods need to train a new model for a new domain by accessing data. Due to public privacy, the new domain data are not always accessible, leading to a limited applicability of these methods. In this paper, we study the problem of multi-source domain generalization in ReID, which aims to learn a model that can perform well on unseen domains with only several labeled source domains. To address this problem, we propose the Memory-based…
What Makes You Unique? Attribute Prompt Composition for Object Re-Identification
School of Information and Communication Engineering, Dalian University of Technology（信息与通信工程学院，大连理工大学）；School of Future Technology, School of Artificial Intelligence, Dalian University of Technology（未来技术学院、人工智能学院，大连理工大学）；Technical Architecture Department, WeChat AI, Tencent, China（技术架构部，微信AI，腾讯，中国）
Recent years have witnessed significant progress in person re-identification (ReID). However, current ReID approaches still suffer from considerable performance degradation when unseen testing domains exhibit different characteristics from the source training ones, known as the domain generalization problem. Given multiple source training domains, previous Domain Generalizable ReID (DG-ReID) methods usually learn all domains together using a shared network, which can't learn sufficient knowledge from each domain. In this paper, we propose a novel Multiple Domain Experts Collaborative Learning …
We address the problem of visible-infrared person re-identification (VI-reID), that is, retrieving a set of person images, captured by visible or infrared cameras, in a cross-modal setting. Two main challenges in VI-reID are intra-class variations across person images, and cross-modal discrepancies between visible and infrared images. Assuming that the person images are roughly aligned, previous approaches attempt to learn coarse image- or rigid part-level person representations that are discriminative and generalizable across different modalities. However, the person images, typically cropped…
HAMoBE: Hierarchical and Adaptive Mixture of Biometric Experts for Video-based Person ReID
Department of Computer Science and Engineering, Michigan State University（密歇根州立大学计算机科学与工程系）；Department of Computer Science, Drexel University（德雷塞尔大学计算机科学系）
Group-CLIP Uncertainty Modeling for Group Re-Identification
Glasgow College（格拉斯哥学院）；University of Electronic Science and Technology of China（电子科技大学）；School of Electronic Information Sichuan University（四川大学电子信息学院）；University of Southern California（南加州大学）
Handling Label Uncertainty for Camera Incremental Person Re-Identification
Institute of Information Engineering, Chinese Academy of Sciences（中国科学院信息工程研究所）；School of Cyber Security, University of Chinese Academy of Sciences（中国科学院大学网络空间安全学院）
Learning Commonality, Divergence and Variety for Unsupervised Visible-Infrared Person Re-identification
Institute of Artificial Intelligence, Xiamen University（厦门大学人工智能研究院）；Shanghai Innovation Institute（上海创新研究院）；School of Informatics, Xiamen University（厦门大学信息学院）；East China Normal University（华东师范大学）
Inception Institute of Artificial Intelligence (IIAI)（起源人工智能研究院）；Mohamed bin Zayed University of Artificial Intelligence（穆罕默德·本·扎耶德人工智能大学）
Person re-identification has seen significant advancement in recent years. However, the ability of learned models to generalize to unknown target domains still remains limited. One possible reason for this is the lack of large-scale and diverse source training data, since manually labeling such a dataset is very expensive and privacy sensitive. To address this, we propose to automatically synthesize a large-scale person re-identification dataset following a set-up similar to real surveillance but with virtual environments, and then use the synthesized person images to train a generalizable per…
Radiologist-in-the-Loop Self-Training for Generalizable CT Metal Artifact Reduction
Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence, Fudan University（复旦大学计算神经科学与类脑智能重点实验室）；School of Computer Science, Fudan University（复旦大学计算机科学技术学院）；College of Stomatology, Shanghai Jiao Tong University（上海交通大学口腔医学院）；National Center for Stomatology（国家口腔医学中心）；National Clinical Research Center for Oral Diseases（国家口腔疾病临床医学研究中心）；Shanghai Key Laboratory of Stomatology and Shanghai Research Institute of Stomatology（上海市口腔医学重点实验室暨上海市口腔医学研究所）；School of Cyber Science and Engineering, Sichuan University（四川大学网络空间安全学院）
