首页/论文/2001.09307

arXiv 2001.093072020-01-25eess.IV

IG-TRACK: IOU Guided Siamese Networks for visual object tracking

Mohana Murali Dasari, Rama Krishna Sai Subrahmanyam Gorthi

英文摘要：

Recently Deep Learning based Siamese Networks with region proposals for visual object tracking becoming more popular. These networks, while testing, perform extra computations on output if trained network, to predict the bounding box. This however hampering the precision of bounding box. In this work, the authors have proposed a network guided by Intersection Over Union(IOU) while training, to predict precise bounding box. This is achieved by adding new loss function in training the network, to maximize IOU of the predicted bounding box with ground truth. While testing on VOT2018, GOT-10k tracking benchmarks,the proposed approach out-performed the base approach by more than 10% in terms of precision.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

基于双重结构特征的Siamese网络用于红外目标跟踪

Twofold Structured Features-Based Siamese Network for Infrared Target Tracking

针对红外目标跟踪中因信息缺乏导致的跟踪漂移问题，提出基于双重结构特征的Siamese网络，通过特征融合网络和多模板更新模块提升判别力与抗干扰能力，在VOT-TIR 2016上实现性能与速度平衡。

2024-06-27eess.IV

On the Interaction Between Deep Detectors and Siamese Trackers in Video Surveillance

École de technologie supérieure（高等技术学院）；Genetec Inc.（Genetec公司）

Visual object tracking is an important function in many real-time video surveillance applications, such as localization and spatio-temporal recognition of persons. In real-world applications, an object detector and tracker must interact on a periodic basis to discover new objects, and thereby to initiate tracks. Periodic interactions with the detector can also allow the tracker to validate and/or update its object template with new bounding boxes. However, bounding boxes provided by a state-of-the-art detector are noisy, due to changes in appearance, background and occlusion, which can cause t…

2019-10-31cs.CVeess.IV

Attentive Dual Stream Siamese U-net for Flood Detection on Multi-temporal Sentinel-1 Data

KTH Royal Institute of Technology（KTH皇家理工学院）

Due to climate and land-use change, natural disasters such as flooding have been increasing in recent years. Timely and reliable flood detection and mapping can help emergency response and disaster management. In this work, we propose a flood detection network using bi-temporal SAR acquisitions. The proposed segmentation network has an encoder-decoder architecture with two Siamese encoders for pre and post-flood images. The network's feature maps are fused and enhanced using attention blocks to achieve more accurate detection of the flooded areas. Our proposed network is evaluated on publicly …

2022-04-20cs.CVeess.IV

Siamese Networks with Location Prior for Landmark Tracking in Liver Ultrasound Sequences

ETH Zurich（苏黎世联邦理工学院）

Image-guided radiation therapy can benefit from accurate motion tracking by ultrasound imaging, in order to minimize treatment margins and radiate moving anatomical targets, e.g., due to breathing. One way to formulate this tracking problem is the automatic localization of given tracked anatomical landmarks throughout a temporal ultrasound sequence. For this, we herein propose a fully-convolutional Siamese network that learns the similarity between pairs of image regions containing the same landmark. Accordingly, it learns to localize and thus track arbitrary image features, not only predefine…

2019-01-23cs.CVeess.IV

Learning to Fuse Asymmetric Feature Maps in Siamese Trackers

Beijing Institute of Technology（北京理工大学）；Inception Institute of Artificial Intelligence（起源人工智能研究院）；Mohamed Bin Zayed University of Artificial Intelligence（穆罕默德·本·扎耶德人工智能大学）

Recently, Siamese-based trackers have achieved promising performance in visual tracking. Most recent Siamese-based trackers typically employ a depth-wise cross-correlation (DW-XCorr) to obtain multi-channel correlation information from the two feature maps (target and search region). However, DW-XCorr has several limitations within Siamese-based tracking: it can easily be fooled by distractors, has fewer activated channels, and provides weak discrimination of object boundaries. Further, DW-XCorr is a handcrafted parameter-free module and cannot fully benefit from offline learning on large-scal…

2021-03-31cs.CVcs.LGeess.IV

Tackling Occlusion in Siamese Tracking with Structured Dropouts

University of Amsterdam（阿姆斯特丹大学）

Occlusion is one of the most difficult challenges in object tracking to model. This is because unlike other challenges, where data augmentation can be of help, occlusion is hard to simulate as the occluding object can be anything in any shape. In this paper, we propose a simple solution to simulate the effects of occlusion in the latent space. Specifically, we present structured dropout to mimick the change in latent codes under occlusion. We present three forms of dropout (channel dropout, segment dropout and slice dropout) with the various forms of occlusion in mind. To demonstrate its effec…

2020-06-30cs.CVcs.LGeess.IV

更多相关论文收起更多论文

COMET: Context-Aware IoU-Guided Network for Small Object Tracking

University of Alberta（阿尔伯塔大学）；Yazd University（亚兹德大学）；Sharif University of Technology（谢里夫理工大学）

We consider the problem of tracking an unknown small target from aerial videos of medium to high altitudes. This is a challenging problem, which is even more pronounced in unavoidable scenarios of drastic camera motion and high density. To address this problem, we introduce a context-aware IoU-guided tracker (COMET) that exploits a multitask two-stream network and an offline reference proposal generation strategy. The proposed network fully exploits target-related information by multi-scale feature learning and attention modules. The proposed strategy introduces an efficient sampling strategy …

2020-09-18cs.CVeess.IV

用于图像引导血管内手术的基于孪生网络的实时导丝尖端跟踪

Real-Time Guidewire Tip Tracking Using a Siamese Network for Image-Guided Endovascular Procedures

本文提出基于孪生网络与双注意力机制的导丝尖端实时跟踪框架，在DSA序列上实现亚毫米级精度和57.2 FPS速度，并验证了其在机器人辅助血管内手术中的有效性。

2025-06-25cs.CVeess.IV

Optimisation of a Siamese Neural Network for Real-Time Energy Efficient Object Tracking

AGH University of Science and Technology（AGH科技大学）

In this paper the research on optimisation of visual object tracking using a Siamese neural network for embedded vision systems is presented. It was assumed that the solution shall operate in real-time, preferably for a high resolution video stream, with the lowest possible energy consumption. To meet these requirements, techniques such as the reduction of computational precision and pruning were considered. Brevitas, a tool dedicated for optimisation and quantisation of neural networks for FPGA implementation, was used. A number of training scenarios were tested with varying levels of optimis…

2020-07-01cs.CVcs.LGeess.IV

Efficient Adversarial Attacks for Visual Object Tracking

Institute of Information Engineering, Chinese Academy of Sciences（中国科学院信息工程研究所）；School of Cyber Security, University of Chinese Academy of Sciences（中国科学院大学网络空间安全学院）；Cyberspace Security Research Center, Peng Cheng Laboratory（鹏城实验室网络空间安全研究中心）；Beijing Key Laboratory of Digital Media, School of Computer Science and Engineering, Beihang University（北京航空航天大学计算机学院数字媒体北京市重点实验室）

Visual object tracking is an important task that requires the tracker to find the objects quickly and accurately. The existing state-ofthe-art object trackers, i.e., Siamese based trackers, use DNNs to attain high accuracy. However, the robustness of visual tracking models is seldom explored. In this paper, we analyze the weakness of object trackers based on the Siamese network and then extend adversarial examples to visual object tracking. We present an end-to-end network FAN (Fast Attack Network) that uses a novel drift loss combined with the embedded feature loss to attack the Siamese netwo…

2020-08-01cs.CVcs.LGeess.IV

迈向 PET/CT 成像中的 AI 病灶追踪：一种应用于 PSMA PET/CT 扫描的基于孪生 CNN 的流程

Towards AI Lesion Tracking in PET/CT Imaging: A Siamese-based CNN Pipeline applied on PSMA PET/CT Scans

Technical University of Munich（慕尼黑工业大学）；TUM School of Natural Sciences（慕尼黑工业大学自然科学学院）；Johns Hopkins University School of Medicine（约翰霍普金斯大学医学院）；Munich Institute of Biomedical Engineering（慕尼黑生物医学工程研究所）

本文提出基于孪生 CNN 的 PET/CT 病灶自动追踪流程，通过分割、配准和病灶块匹配，在 PSMA PET/CT 骨病灶追踪中取得最高 83% 准确率与 0.91 AUC。

2024-07-08cs.CVeess.IVphysics.med-ph

RSINet: Rotation-Scale Invariant Network for Online Visual Tracking

Korea Advanced Institute of Science and Technology (KAIST)（韩国高等科学技术院（KAIST））；Inha University（仁荷大学）

Most Siamese network-based trackers perform the tracking process without model update, and cannot learn targetspecific variation adaptively. Moreover, Siamese-based trackers infer the new state of tracked objects by generating axis-aligned bounding boxes, which contain extra background noise, and are unable to accurately estimate the rotation and scale transformation of moving objects, thus potentially reducing tracking performance. In this paper, we propose a novel Rotation-Scale Invariant Network (RSINet) to address the above problem. Our RSINet tracker consists of a target-distractor discri…

2020-11-18cs.CVcs.LGeess.IV

Image Quality Assessment with Gradient Siamese Network

Netease Inc（网易公司）

In this work, we introduce Gradient Siamese Network (GSN) for image quality assessment. The proposed method is skilled in capturing the gradient features between distorted images and reference images in full-reference image quality assessment(IQA) task. We utilize Central Differential Convolution to obtain both semantic features and detail difference hidden in image pair. Furthermore, spatial attention guides the network to concentrate on regions related to image detail. For the low-level, mid-level and high-level features extracted by the network, we innovatively design a multi-level fusion m…

2022-08-08cs.CVeess.IV

Online Multiple Pedestrians Tracking using Deep Temporal Appearance Matching Association

Hyundai Motor Company（现代汽车公司）；RMIT University（皇家墨尔本理工大学）；SI-Analytics Company, Ltd.（SI分析有限公司）；GIST（韩国科学技术院）

In online multi-target tracking, modeling of appearance and geometric similarities between pedestrians visual scenes is of great importance. The higher dimension of inherent information in the appearance model compared to the geometric model is problematic in many ways. However, due to the recent success of deep-learning-based methods, handling of high-dimensional appearance information becomes feasible. Among many deep neural networks, Siamese network with triplet loss has been widely adopted as an effective appearance feature extractor. Since the Siamese network can extract the features of e…

2020-10-09cs.CVcs.LGeess.IV

Integration of Regularized l1 Tracking and Instance Segmentation for Video Object Tracking

Istanbul Technical University（伊斯坦布尔理工大学）

We introduce a tracking-by-detection method that integrates a deep object detector with a particle filter tracker under the regularization framework where the tracked object is represented by a sparse dictionary. A novel observation model which establishes consensus between the detector and tracker is formulated that enables us to update the dictionary with the guidance of the deep detector. This yields an efficient representation of the object appearance through the video sequence hence improves robustness to occlusion and pose changes. Moreover we propose a new state vector consisting of tra…

2019-12-30cs.CVeess.IV