Learning a Robust Society of Tracking Parts using Co-occurrence Constraints
Bitdefender(比特梵德);Institute of Mathematics of the Romanian Academy(罗马尼亚科学院数学研究所);University of Bucharest(布加勒斯特大学);University Politehnica of Bucharest(布加勒斯特理工大学)
Object tracking is an essential problem in computer vision that has been researched for several decades. One of the main challenges in tracking is to adapt to object appearance changes over time and avoiding drifting to background clutter. We address this challenge by proposing a deep neural network composed of different parts, which functions as a society of tracking parts. They work in conjunction according to a certain policy and learn from each other in a robust manner, using co-occurrence constraints that ensure robust inference and learning. From a structural point of view, our network is composed of two main pathways. One pathway is more conservative. It carefully monitors a large set of simple tracker parts learned as linear filters over deep feature activation maps. It assigns the parts different roles. It promotes the reliable ones and removes the inconsistent ones. We learn these filters simultaneously in an efficient way, with a single closed-form formulation, for which we propose novel theoretical properties. The second pathway is more progressive. It is learned completely online and thus it is able to better model object appearance changes. In order to adapt in a robust manner, it is learned only on highly confident frames, which are decided using co-occurrences with the first pathway. Thus, our system has the full benefit of two main approaches in tracking. The larger set of simpler filter parts offers robustness, while the full deep network learned online provides adaptability to change. As shown in the experimental section, our approach achieves state of the art performance on the challenging VOT17 benchmark, outperforming the published methods both on the general EAO metric and in the number of fails, by a significant margin.
Cell as Point: One-Stage Framework for Efficient Cell Tracking
School of Computer Science, The University of Sydney(悉尼大学计算机科学学院);Department of Computer Science, University of Maryland College Park(马里兰大学学院公园分校计算机科学系);Microsoft(微软公司)
SRRT: Exploring Search Region Regulation for Visual Object Tracking
School of Information and Communication Engineering, Dalian University of Technology(大连理工大学信息与通信工程学院);School of Computer Science and Technology, Dalian University of Technology(大连理工大学计算机科学与技术学院)
Spatio-temporal Graph Learning on Adaptive Mined Key Frames for High-performance Multi-Object Tracking
School of Computer Science and Technology, Anhui University(安徽大学计算机科学与技术学院);Anhui Provincial Key Laboratory of Multimodal Cognitive Computation(安徽省多模态认知计算重点实验室)