Coordinate-Aware Thermal Infrared Tracking Via Natural Language Modeling
School of Optoelectronic Science and Engineering, University of Electronic Science and Technology of China(电子科技大学光电科学与工程学院);Yibin Institute, University of Electronic Science and Technology of China(电子科技大学宜宾研究院);NO.208 research institute of China Ordnance Industries(中国兵器工业第208研究所)
Miao Yan, Ping Zhang, Haofei Zhang, Ruqian Hao, Juanxiu Liu, Xiaoyang Wang, Lin Liu
Thermal infrared (TIR) tracking is pivotal in computer vision tasks due to its all-weather imaging capability. Traditional tracking methods predominantly rely on hand-crafted features, and while deep learning has introduced correlation filtering techniques, these are often constrained by rudimentary correlation operations. Furthermore, transformer-based approaches tend to overlook temporal and coordinate information, which is critical for TIR tracking that lacks texture and color information. In this paper, to address these issues, we apply natural language modeling to TIR tracking and propose a coordinate-aware thermal infrared tracking model called NLMTrack, which enhances the utilization of coordinate and temporal information. NLMTrack applies an encoder that unifies feature extraction and feature fusion, which simplifies the TIR tracking pipeline. To address the challenge of low detail and low contrast in TIR images, on the one hand, we design a multi-level progressive fusion module that enhances the semantic representation and incorporates multi-scale features. On the other hand, the decoder combines the TIR features and the coordinate sequence features using a causal transformer to generate the target sequence step by step. Moreover, we explore an adaptive loss aimed at elevating tracking accuracy and a simple template update strategy to accommodate the target's appearance variations. Experiments show that NLMTrack achieves state-of-the-art performance on multiple benchmarks. The Code is publicly available at \url{https://github.com/ELOESZHANG/NLMTrack}.
SMTT: Novel Structured Multi-task Tracking with Graph-Regularized Sparse Representation for Robust Thermal Infrared Target Tracking
College of Computer and Information Technology, China Three Gorges University(三峡大学计算机与信息学院);Hubei Province Engineering Technology Research Center for Construction Quality Testing Equipment, China Three Gorges University(三峡大学湖北省建筑质量检测装备工程技术研究中心);Hubei Key Laboratory of Intelligent Vision Based Monitoring for Hydroelectric Engineering, China Three Gorges University(三峡大学水电工程智能视觉监测湖北省重点实验室)
Infrared target tracking based on proximal robust principal component analysis method
School of Electronic and Optical Engineering, Nanjing University of Science and Technology(南京理工大学电子工程与光电技术学院);The 28th Research Institute of China Electronics Technology Corporation(中国电子科技集团公司第二十八研究所)
Using Panoramic Videos for Multi-person Localization and Tracking in a 3D Panoramic Coordinate
Nara Institute of Science and Technology(奈良先端科学技术大学院大学);Osaka University(大阪大学);Kyoto University(京都大学);RIKEN, Center for Advanced Intelligence Project(理化学研究所先进智能项目中心)
A Comparative Study of Object Trackers for Infrared Flying Bird Tracking
Beihang University(北京航空航天大学);Temple University(天普大学);US Air Force Research Laboratory(美国空军研究实验室);China Academy of Civil Aviation Science and Technology(中国民航科学技术研究院)
Infrared UAV Target Tracking with Dynamic Feature Refinement and Global Contextual Attention Knowledge Distillation
School of Computer Science and Technology, Xidian University(西安电子科技大学计算机科学与技术学院);Xi’an Modern Control Technology Research Institute(西安现代控制技术研究所);School of Artificial Intelligence and Automation, Huazhong University of Science and Technology(华中科技大学人工智能与自动化学院)
In Defense and Revival of Bayesian Filtering for Thermal Infrared Object Tracking
School of Cyber Science and Engineering, Qufu Normal University(曲阜师范大学网络与网络安全学院);School of Computer Science and Technology, East China Normal University(华东师范大学计算机科学与技术学院);School of Integrated Circuits, Harbin Institute of Technology(哈尔滨工业大学集成电路学院);Faculty of Software and Information Science, Iwate Prefectural University(岩手县立大学软件与信息科学学部)
RAMCT: Novel Region-adaptive Multi-channel Tracker with Iterative Tikhonov Regularization for Thermal Infrared Tracking
College of Computer and Information Technology, China Three Gorges University(中国三峡大学计算机与信息学院);Hubei Province Engineering Technology Research Center for Construction Quality Testing Equipment, China Three Gorges University(中国三峡大学湖北省建筑质量检测装备工程技术研究中心);Hubei Key Laboratory of Intelligent Vision Based Monitoring for Hydroelectric Engineering, China Three Gorges University(中国三峡大学水电工程智能视觉监测湖北省重点实验室)
STARS: Sparse Learning Correlation Filter with Spatio-temporal Regularization and Super-resolution Reconstruction for Thermal Infrared Target Tracking
College of Computer and Information Technology, China Three Gorges University(中国三峡大学计算机与信息学院);Hubei Province Engineering Technology Research Center for Construction Quality Testing Equipment, China Three Gorges University(中国三峡大学湖北省建筑质量检测装备工程技术研究中心);Hubei Key Laboratory of Intelligent Vision Based Monitoring for Hydroelectric Engineering, China Three Gorges University(中国三峡大学水电工程智能视觉监测湖北省重点实验室)
DCFG: Diverse Cross-Channel Fine-Grained Feature Learning and Progressive Fusion Siamese Tracker for Thermal Infrared Target Tracking
College of Computer and Information Technology, China Three Gorges University(中国三峡大学计算机与信息学院);Hubei Province Engineering Technology Research Center for Construction Quality Testing Equipment, China Three Gorges University(中国三峡大学湖北省建筑质量检测装备工程技术研究中心);Wuhan College(武汉学院)
Track without Appearance: Learn Box and Tracklet Embedding with Local and Global Motion Patterns for Vehicle Tracking
Zhejiang University(浙江大学);Hangzhou Dianzi University(杭州电子科技大学);Guangdong University of Petrochemical Technology(广东石油化工学院);University of Washington(华盛顿大学)
Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳));Peng Cheng Laboratory(鹏城实验室);Anhui University(安徽大学);Southern University of Science and Technology(南方科技大学)
Point Tracking in Surgery--The 2025 Surgical Tattoos in Infrared Challenge (STIRC2025)
Intuitive Surgical Inc.(直观外科公司);ImFusion GmbH(ImFusion有限公司);Technical University of Munich(慕尼黑工业大学);University of British Columbia(英属哥伦比亚大学);Johns Hopkins University(约翰·霍普金斯大学);Daegu Gyeongbuk Institute of Science and Technology(大邱庆北科学技术院);Hamburg University of Technology(汉堡工业大学);SustAInLivWork Center of Excellence(可持续生活工作卓越中心);Graduate School of Informatics, Nagoya University(名古屋大学信息科学研究生院);Information Technology Center, Nagoya University(名古屋大学信息技术中心);Department of Information Science, Aichi Institute of Technology(爱知工业大学信息科学系);Research Center for Medical Bigdata, National Institute of Informatics(国立信息学研究所医学大数据研究中心);Department of Translational Surgical Oncology, National Center for Tumor Diseases (NCT), NCT/UCC Dresden, a partnership between DKFZ, Faculty of Medicine and University Hospital Carl Gustav Carus, TUD Dresde(德累斯顿国家肿瘤疾病中心(NCT)转化外科肿瘤学系,NCT/UCC德累斯顿,由德国癌症研究中心、医学院和卡尔·古斯塔夫·卡鲁斯大学医院、德累斯顿工业大学合作成立)
FGSGT: Saliency-Guided Siamese Network Tracker Based on Key Fine-Grained Feature Information for Thermal Infrared Target Tracking
College of Computer and Information Technology, China Three Gorges University(三峡大学计算机与信息学院);Hubei Province Engineering Technology Research Center for Construction Quality Testing Equipment, China Three Gorges University(三峡大学湖北省建筑质量检测装备工程技术研究中心);Nantong Institute of Technology(南通理工学院);Wuhan College(武汉学院)
AmbientEye: A Dataset for Pupil Segmentation under Natural Ambient Infrared Illumination
Electrical Engineering, Korea Advanced Institute of Science and Technology(电子工程系,韩国科学技术院);Intelligent Systems Department, Delft University of Technology(智能系统系,代尔夫特理工大学)
Point Tracking in Surgery--The 2024 Surgical Tattoos in Infrared (STIR) Challenge
Intuitive Surgical Inc.(直觉外科公司);ImFusion GmbH(ImFusion 有限公司);Technical University of Munich(慕尼黑工业大学);NVIDIA(英伟达公司);Daegu Gyeongbuk Institute of Science and Technology (DGIST)(大邱庆北科学技术院);Czech Technical University in Prague(布拉格捷克技术大学);Shenzhen Research Institute(深圳研究院);The Chinese University of Hong Kong(香港中文大学);Shenzhen University(深圳大学);Life and Health Sciences Research Institute (ICVS)(生命与健康科学研究所);University of Minho(米尼奥大学);IPCA(波尔图高等理工学院);University of California - Los Angeles (UCLA)(加利福尼亚大学洛杉矶分校);Hefei University of Technology(合肥工业大学);Hawkes Institute(霍克斯研究所)
Cooperative Medianet Innovation Center(合作 medianet 创新中心);Shanghai Jiao Tong University(上海交通大学);Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));CloudWalk Technology Co., Ltd(云从科技股份有限公司);Shanghai AI Laboratory(上海人工智能实验室)
Evaluating Sensitivity Parameters in Smartphone-Based Gaze Estimation: A Comparative Study of Appearance-Based and Infrared Eye Trackers
School of Computer, Data and Mathematical Sciences, Western Sydney University, Penrith, New South Wales, Australia(计算机、数据与数学科学学院,西悉尼大学,彭里,新南威尔士州,澳大利亚);The MARCS Institute for Brain, Behaviour and Development, Western Sydney University, Penrith, NSW, Australia(脑行为与发育研究所,西悉尼大学,彭里,新南威尔士州,澳大利亚);School of Systems and Computing, University of New South Wales, Canberra, ACT, Australia(系统与计算学院,新南威尔士大学,堪培拉,澳大利亚)