This paper proposes the SVDNet for retrieval problems, with focus on the application of person re-identification (re-ID). We view each weight vector within a fully connected (FC) layer in a convolutional neuron network (CNN) as a projection basis. It is observed that the weight vectors are usually highly correlated. This problem leads to correlations among entries of the FC descriptor, and compromises the retrieval performance based on the Euclidean distance. To address the problem, this paper proposes to optimize the deep representation learning process with Singular Vector Decomposition (SVD). Specifically, with the restraint and relaxation iteration (RRI) training scheme, we are able to iteratively integrate the orthogonality constraint in CNN training, yielding the so-called SVDNet. We conduct experiments on the Market-1501, CUHK03, and Duke datasets, and show that RRI effectively reduces the correlation among the projection vectors, produces more discriminative FC descriptors, and significantly improves the re-ID accuracy. On the Market-1501 dataset, for instance, rank-1 accuracy is improved from 55.3% to 80.5% for CaffeNet, and from 73.8% to 82.3% for ResNet-50.
Multi-direction and Multi-scale Pyramid in Transformer for Video-based Pedestrian Retrieval
Peking University(北京大学)
在视频监控中,行人检索(也称为人员重新识别)是一项关键任务。该任务旨在从非重叠摄像机中检索感兴趣的行人。最近,基于transformer的模型在这方面取得了重大进展。然而,这些模型仍然存在忽略细粒度、部分信息的问题。本文提出了一种多方向多尺度的Pyramid in Transformer(PiT)模型来解决这一问题。在基于变换器的架构中,每个行人图像被分成许多块。然后,这些补丁被馈送到Transformer层,以获得该图像的特征表示。为了挖掘细节信息,本文提出对这些面片进行垂直分割和水平分割,生成不同方向的人体部位。这些部分提供更细粒度的信息。为了融合多尺度特征表示,本文提出了一种包含全局信息和多个不同尺度的局部信息的金字塔结构。将同一视频中所有行人图像的特征金字塔进行融合,形成最终的多方向多尺度特征表示。两个具有挑战性的基于视频的基准,MARS和iLIDS-VID上的实验结果表明,所提出的PiT实现了最先进的性能。广泛的消融研究证明了所提出的金字塔结构的优越性。该代码可在https://git.openi.org.cn/zangxh/PiT.git上获得。
Do Not Disturb Me: Person Re-identification Under the Interference of Other Pedestrians
Key Laboratory of Image Processing and Intelligent Control, School of Artificial Intelligence and Automation, Huazhong University of Science and Technology(华中科技大学人工智能与自动化学院图像处理与智能控制重点实验室);Tencent Youtu Lab(腾讯优图实验室);Sun Yat-sen University(中山大学)
FitPro: A Zero-Shot Framework for Interactive Text-based Pedestrian Retrieval in Open World
Key Lab of Education Blockchain and Intelligent Technology, Ministry of Education, Guangxi Normal University(教育区块链与智能技术重点实验室,教育部,广西师范大学);Guangxi Key Lab of Multi-source Information Mining & Security, Guangxi Normal University(广西多源信息挖掘与安全重点实验室,广西师范大学)
Pose-Aided Video-based Person Re-Identification via Recurrent Graph Convolutional Network
Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳));Chongqing Normal University(重庆师范大学);National Center for Applied Mathematics in Chongqing(重庆国家应用数学中心);Northeast Forestry University(东北林业大学);Inner Mongolia University(内蒙古大学);Southern University of Science and Technology(南方科技大学)
Lightweight Attribute Localizing Models for Pedestrian Attribute Recognition
Skolkovo Institute of Science and Technology (SKOLTECH)(斯科尔科沃科学技术研究所);Innopolis University(因诺波利斯大学);University of Sharjah(沙迦大学);Advanced Micro Devices (AMD)(超威半导体);University of Brighton(布莱顿大学)
Channel Recurrent Attention Networks for Video Pedestrian Retrieval
The Australian National University(澳大利亚国立大学);DATA61-CSIRO(澳大利亚联邦科学与工业研究组织数据61部);NEC Laboratories America(美国电气股份有限公司实验室);OPPO US Research Center(OPPO美国研究中心);Monash University(莫纳什大学)
School of Computer Science and Electronic Engineering, University of Essex(埃塞克斯大学计算机科学与电子工程学院);School of Electrical Engineering and Computer Science, Queensland University of Technology(昆士兰科技大学电气工程与计算机科学学院)
SA-Person: Text-Based Person Retrieval with Scene-aware Re-ranking
School of Computer Science and Technology, Soochow University(苏州大学计算机科学与技术学院);Centre for Artificial Intelligence and Robotics, Hong Kong Institute of Science and Innovation, Chinese Academy of Sciences(中国科学院香港创新研究院人工智能与机器人中心);Multimodal Artificial Intelligence Systems (MAIS), Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所多模态人工智能系统(MAIS));Wuhan University(武汉大学);University of Chinese Academy of Sciences(中国科学院大学)
Heterogeneous Vision-Language Ensemble with Disagreement-Aware Reranking for Text-Based Person Anomaly Retrieval
Hanoi University of Science and Technology(河内科技大学);University of Information Technology, VNU-HCM(胡志明市国家大学信息技术大学);Vietnam National University, Ho Chi Minh City(胡志明市国家大学);VinUniversity;Vietnamese-German University(越南德国大学)