Markerless tracking of hands and fingers is a promising enabler for human-computer interaction. However, adoption has been limited because of tracking inaccuracies, incomplete coverage of motions, low framerate, complex camera setups, and high computational requirements. In this paper, we present a fast method for accurately tracking rapid and complex articulations of the hand using a single depth camera. Our algorithm uses a novel detection-guided optimization strategy that increases the robustness and speed of pose estimation. In the detection step, a randomized decision forest classifies pixels into parts of the hand. In the optimization step, a novel objective function combines the detected part labels and a Gaussian mixture representation of the depth to estimate a pose that best fits the depth. Our approach needs comparably less computational resources which makes it extremely fast (50 fps without GPU support). The approach also supports varying static, or moving, camera-to-scene arrangements. We show the benefits of our method by evaluating on public datasets and comparing against previous work.
基于整体对象表示的跟踪器在大的外观变化(如变形和遮挡)下性能下降。在这项工作中,我们提出了一个动态的部分为基础的跟踪器,并不断更新的目标部分表示,以适应对象的外观变化。此外,我们设计了一个注意力引导的零件定位网络,直接预测目标零件的位置,并确定最终的限界框与目标零件的分布。我们提出的跟踪器在各种基准测试中取得了令人鼓舞的结果:VOT 2018,OTB 100和GOT-10 k
Exploiting Offset-guided Network for Pose Estimation and Tracking
Beijing Laboratory of Advanced Information Networks(北京先进信息网络实验室);Beijing University of Posts and Telecommunications(北京邮电大学);Horizon Robotics(地平线机器人);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)
Layer-Guided UAV Tracking: Enhancing Efficiency and Occlusion Robustness
Department of Control Science and Engineering, University of Shanghai for Science and Technology(上海理工大学控制科学与工程学院);Busness School, University of Shanghai for Science and Technology(上海理工大学商学院)
City-Scale Multi-Camera Vehicle Tracking Guided by Crossroad Zones
State Key Laboratory of Computer Science Institute of Software Chinese Academy of Sciences(中国科学院软件研究所计算机科学国家重点实验室);University of Chinese Academy of Sciences(中国科学院大学);Machine Intelligence Technology Lab Alibaba Group(阿里巴巴集团机器智能技术实验室)
Instance Significance Guided Multiple Instance Boosting for Robust Visual Tracking
School of Computer Science, Beijing Institute of Technology(北京理工大学计算机学院);School of Information Science and Technology, Lingnan Normal University(岭南师范学院信息科学与技术学院);Beijing Laboratory of Intelligent Information Technology(北京智能信息技术实验室)
Enhancing Multi-Camera People Tracking with Anchor-Guided Clustering and Spatio-Temporal Consistency ID Re-Assignment
University of Washington(华盛顿大学);Electronics and Telecommunications Research Institute(电子与电信研究所);National Center for High-Performance Computing(国家高性能计算中心)
提出一种结合锚定引导聚类与时空一致性的多摄像机多人员跟踪方法,在CVPR AI City Challenge 2023上以95.36% IDF1获第一名。
MammoTracker: Mask-Guided Lesion Tracking in Temporal Mammograms
Department of Electrical and Computer Engineering, Duke University, Durham, NC(电气与计算机工程系,杜克大学);Department of Biomedical Engineering, Duke University, Durham, NC(生物医学工程系,杜克大学);Department of Radiology, Duke University School of Medicine, Durham,NC(放射学系,杜克大学医学学院);Departments Population Health Science and Mathematics, Duke University School of Medicine, Durham,NC(流行病学与数学系,杜克大学医学学院)
Modality-Guided Dynamic Graph Fusion and Temporal Diffusion for Self-Supervised RGB-T Tracking
School of Computer Sciences and Technology, China University of Mining and Technology(中国矿业大学计算机科学与技术学院);Mine Digitization Engineering Research Center of the Ministry of Education, China(教育部 mine 数字化工程研究中心)
Real-World Point Tracking with Verifier-Guided Pseudo-Labeling
Department of Computer Engineering, Koç University(科卡大学计算机工程系);KUIS AI Center(KUIS人工智能中心);School of Artificial Intelligence, Shanghai Jiao Tong University(上海交通大学人工智能学院)
Dynamic Attention guided Multi-Trajectory Analysis for Single Object Tracking
Anhui University(安徽大学);The University of Sydney(悉尼大学);Peng Cheng Laboratory(鹏城实验室);Peking University(北京大学);University of Science and Technology of China(中国科学技术大学)
TENet: Targetness Entanglement Incorporating with Multi-Scale Pooling and Mutually-Guided Fusion for RGB-E Object Tracking
School of Artificial Intelligence and Computer Science, Jiangnan University(江南大学人工智能与计算机科学学院);Centre for Vision, Speech and Signal Processing (CVSSP), University of Surrey(萨里大学视觉、语音与信号处理中心)
SMART tracking: Simultaneous anatomical imaging and real-time passive device tracking for MR-guided interventions
Image Sciences Institute, University Medical Center Utrecht(乌得勒支大学医学中心影像科学研究所);University Medical Center Utrecht(乌得勒支大学医学中心);Utrecht(乌得勒支(城市名,此处不单独作为机构,仅保留原英文机构名中的城市信息但按要求不提取城市))
China-UAE Belt and Road Joint Laboratory on Intelligent Unmanned Systems, School of Aerospace Engineering, Beijing Institute of Technology(中国-阿联酋“一带一路”智能无人系统联合实验室,北京理工大学宇航学院)
Tracking and Reconstructing Hand Object Interactions from Point Cloud Sequences in the Wild
Peking University(北京大学);Beijing Institute for General AI(北京通用人工智能研究院);Virginia Tech(弗吉尼亚理工大学);Stanford University(斯坦福大学);Tsinghua University(清华大学);Columbia University(哥伦比亚大学)
Motion-guided sparse correction enables expert-quality point tracking across diverse microscopy regimes
Department of Computer Science, Old Dominion University(奥德赛大学计算机科学系);Department of Biology, Massachusetts Institute of Technology(麻省理工学院生物学系);The Picower Institute for Learning and Memory, Massachusetts Institute of Technology(麻省理工学院学习与记忆研究所);Department of Physics and Technology, UiT--The Arctic University of Norway(挪威北极大学物理与技术系);Department of Physics, University of Oslo(奥斯陆大学物理系);School of Data Science, Old Dominion University(奥德赛大学数据科学学院);Department of Physics, Old Dominion University(奥德赛大学物理系)
HieDG: A Hierarchical Discrete Geometry-Guided Framework for Multi-Animal Tracking
State Key Laboratory of Brain Cognition and Brain-inspired Intelligence Technology, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所脑认知与脑启发智能技术国家重点实验室);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);School of Technology, Beijing Forestry University(北京林业大学工学院);School of Advanced Interdisciplinary Sciences, University of Chinese Academy of Sciences(中国科学院大学前沿交叉科学学院);College of Computer Science, Sichuan University(四川大学计算机学院);C²DL, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所C²DL);School of Automation, Chongqing University(重庆大学自动化学院);Faculty of Life and Health Sciences, Shenzhen University of Advanced Technology(深圳理工大学生命健康学院);School of Future Technology, University of Chinese Academy of Sciences(中国科学院大学未来技术学院)
MrTrack: Register Mamba for Needle Tracking with Rapid Reciprocating Motion during Ultrasound-Guided Aspiration Biopsy
Department of Mechanical and Automation Engineering(机械与自动化工程系);Department of Computer Science and Engineering(计算机科学与工程系);Department of Medicine and Therapeutics and Institute of Digestive Disease(医学与治疗学系和消化疾病研究所);The Chinese University of Hong Kong(香港中文大学)
3D Hand Pose Tracking and Estimation Using Stereo Matching
City University of Hong Kong(香港城市大学);Shenyang Institute of Automation, Chinese Academy of Sciences(中国科学院沈阳自动化研究所);University of Chinese Academy of Sciences(中国科学院大学)
ReWorld-Track: A Recursive Event World Model for Language-Guided Multi-Camera Tracking
Huazhong University of Science and Technology(华中科技大学);Jiangxi University of Water Resources and Electric Power(江西水利电力大学);Zhongnan University of Economics and Law(中南财经政法大学)