Often the best performing deep neural models are ensembles of multiple base-level networks, nevertheless, ensemble learning with respect to domain adaptive person re-ID remains unexplored. In this paper, we propose a multiple expert brainstorming network (MEB-Net) for domain adaptive person re-ID, opening up a promising direction about model ensemble problem under unsupervised conditions. MEB-Net adopts a mutual learning strategy, where multiple networks with different architectures are pre-trained within a source domain as expert models equipped with specific features and knowledge, while the adaptation is then accomplished through brainstorming (mutual learning) among expert models. MEB-Net accommodates the heterogeneity of experts learned with different architectures and enhances discrimination capability of the adapted re-ID model, by introducing a regularization scheme about authority of experts. Extensive experiments on large-scale datasets (Market-1501 and DukeMTMC-reID) demonstrate the superior performance of MEB-Net over the state-of-the-arts.
Recent years have witnessed significant progress in person re-identification (ReID). However, current ReID approaches still suffer from considerable performance degradation when unseen testing domains exhibit different characteristics from the source training ones, known as the domain generalization problem. Given multiple source training domains, previous Domain Generalizable ReID (DG-ReID) methods usually learn all domains together using a shared network, which can't learn sufficient knowledge from each domain. In this paper, we propose a novel Multiple Domain Experts Collaborative Learning …
Weakly Supervised Visible-Infrared Person Re-Identification via Heterogeneous Expert Collaborative Consistency Learning
Faculty of Information Engineering and Automation, Kunming University of Science and Technology(昆明理工大学信息工程与自动化学院);School of Computer Science and Technology, Harbin Institute of Technology(哈尔滨工业大学计算机科学与技术学院)
Hunan University(湖南大学);National Engineering Laboratory for Robot Visual Perception and Control Technology(机器人视觉感知与控制技术国家工程实验室);University of California, Riverside(加州大学河滨分校)
The success of deep neural networks (DNNs) has promoted the widespread applications of person re-identification (ReID). However, ReID systems inherit the vulnerability of DNNs to malicious attacks of visually inconspicuous adversarial perturbations. Detection of adversarial attacks is, therefore, a fundamental requirement for robust ReID systems. In this work, we propose a Multi-Expert Adversarial Attack Detection (MEAAD) approach to achieve this goal by checking context inconsistency, which is suitable for any DNN-based ReID systems. Specifically, three kinds of context inconsistencies caused…
Peking University(北京大学);Singapore University of Technology and Design(新加坡科技设计大学);National University of Singapore(新加坡国立大学);Peng Cheng Laboratory(鹏城实验室)
Domain generalizable (DG) person re-identification (ReID) is a challenging problem because we cannot access any unseen target domain data during training. Almost all the existing DG ReID methods follow the same pipeline where they use a hybrid dataset from multiple source domains for training, and then directly apply the trained model to the unseen target domains for testing. These methods often neglect individual source domains' discriminative characteristics and their relevances w.r.t. the unseen target domains, though both of which can be leveraged to help the model's generalization. To han…
FlexiReID: Adaptive Mixture of Expert for Multi-Modal Person Re-Identification
Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University(多媒体可信感知与高效计算重点实验室,中国教育部,厦门大学);National University of Singapore(新加坡国立大学);Tencent YouTu Lab(腾讯优图实验室);Institute of Artificial Intelligence,Xiamen University(人工智能研究院,厦门大学)
MFEN:Multi-Frequency Expert Network for Visible-Infrared Person Re-ID
University of Science and Technology of China(中国科学技术大学);Anhui Province Key Laboratory of Digital Security(安徽省数字安全重点实验室);The Chinese University of Hong Kong(香港中文大学)
HAMoBE: Hierarchical and Adaptive Mixture of Biometric Experts for Video-based Person ReID
Department of Computer Science and Engineering, Michigan State University(密歇根州立大学计算机科学与工程系);Department of Computer Science, Drexel University(德雷塞尔大学计算机科学系)
University of Chinese Academy of Sciences(中国科学院大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Longfor Inc.(龙湖集团)
Domain generalizable (DG) person re-identification (ReID) aims to test across unseen domains without access to the target domain data at training time, which is a realistic but challenging problem. In contrast to methods assuming an identical model for different domains, Mixture of Experts (MoE) exploits multiple domain-specific networks for leveraging complementary information between domains, obtaining impressive results. However, prior MoE-based DG ReID methods suffer from a large model size with the increase of the number of source domains, and most of them overlook the exploitation of dom…
View-Aware Semantic Alignment for Aerial-Ground Person Re-Identification
Sun Yat-sen University, China(中山大学,中国);Pazhou Lab (HuangPu), Guangdong, China(琶洲实验室(黄埔),广东,中国);Guangdong Province Key Laboratory of Information Security Technology, Guangzhou, China(广东省信息安全技术重点实验室,广州,中国);Key Laboratory of Machine Intelligence and Advanced Computing, Ministry of Education, China(教育部机器智能与高级计算重点实验室,中国)
Leibniz Information Centre for Science and Technology (TIB)(莱布尼茨科学技术信息中心(TIB));L3S Research Center(L3S研究中心);University of Marburg(马尔堡大学);German Broadcasting Archive (DRA)(德国广播档案馆(DRA))
Video indexing approaches such as visual concept classification and person recognition are essential to enable fine-grained semantic search in large-scale video archives such as the historical video collection of former German Democratic Republic (GDR) maintained by the German Broadcasting Archive (DRA). Typically, a lexicon of visual concepts has to be defined for semantic search. However, the definition of visual concepts can be more or less subjective due to individually differing judgments of annotators, which may have an impact on annotation quality and subsequently training of supervised…