Accurate detection of 3D objects is a fundamental problem in computer vision and has an enormous impact on autonomous cars, augmented/virtual reality and many applications in robotics. In this work we present a novel fusion of neural network based state-of-the-art 3D detector and visual semantic segmentation in the context of autonomous driving. Additionally, we introduce Scale-Rotation-Translation score (SRTs), a fast and highly parameterizable evaluation metric for comparison of object detections, which speeds up our inference time up to 20\% and halves training time. On top, we apply state-of-the-art online multi target feature tracking on the object measurements to further increase accuracy and robustness utilizing temporal information. Our experiments on KITTI show that we achieve same results as state-of-the-art in all related categories, while maintaining the performance and accuracy trade-off and still run in real-time. Furthermore, our model is the first one that fuses visual semantic with 3D object detection.
Object tracking is the cornerstone of many visual analytics systems. While considerable progress has been made in this area in recent years, robust, efficient, and accurate tracking in real-world video remains a challenge. In this paper, we present a hybrid tracker that leverages motion information from the compressed video stream and a general-purpose semantic object detector acting on decoded frames to construct a fast and efficient tracking engine. The proposed approach is compared with several well-known recent trackers on the OTB tracking dataset. The results indicate advantages of the pr…
Chittagong University of Engineering and Technology（吉大港工程技术大学）
Wrong-way driving is one of the main causes of road accidents and traffic jam all over the world. By detecting wrong-way vehicles, the number of accidents can be minimized and traffic jam can be reduced. With the increasing popularity of real-time traffic management systems and due to the availability of cheaper cameras, the surveillance video has become a big source of data. In this paper, we propose an automatic wrong-way vehicle detection system from on-road surveillance camera footage. Our system works in three stages: the detection of vehicles from the video frame by using the You Only Lo…
Indian Institute of Information Technology Allahabad（印度阿拉哈巴德信息技术学院）；Comptroller and Auditor General of India（印度主计审计长公署）
The rampant coronavirus disease 2019 (COVID-19) has brought global crisis with its deadly spread to more than 180 countries, and about 3,519,901 confirmed cases along with 247,630 deaths globally as on May 4, 2020. The absence of any active therapeutic agents and the lack of immunity against COVID-19 increases the vulnerability of the population. Since there are no vaccines available, social distancing is the only feasible approach to fight against this pandemic. Motivated by this notion, this article proposes a deep learning based framework for automating the task of monitoring social distanc…
University of Kansas（堪萨斯大学）；Ainstein Inc.（Ainstein公司）；Ryerson University（瑞尔森大学）
This paper focuses on the problem of online golf ball detection and tracking from image sequences. An efficient real-time approach is proposed by exploiting convolutional neural networks (CNN) based object detection and a Kalman filter based prediction. Five classical deep learning-based object detection networks are implemented and evaluated for ball detection, including YOLO v3 and its tiny version, YOLO v4, Faster R-CNN, SSD, and RefineDet. The detection is performed on small image patches instead of the entire image to increase the performance of small ball detection. At the tracking stage…
Following the recent advances in deep networks, object detection and tracking algorithms with deep learning backbones have been improved significantly; however, this rapid development resulted in the necessity of large amounts of annotated labels. Even if the details of such semi-automatic annotation processes for most of these datasets are not known precisely, especially for the video annotations, some automated labeling processes are usually employed. Unfortunately, such approaches might result with erroneous annotations. In this work, different types of annotation errors for object detectio…
University of Washington（华盛顿大学）；University of Tokyo（东京大学）；Microsoft Research（微软研究院）
Tracking of multiple objects is an important application in AI City geared towards solving salient problems related to safety and congestion in an urban environment. Frequent occlusion in traffic surveillance has been a major problem in this research field. In this challenge, we propose a model-based vehicle localization method, which builds a kernel at each patch of the 3D deformable vehicle model and associates them with constraints in 3D space. The proposed method utilizes shape fitness evaluation besides color information to track vehicle objects robustly and efficiently. To build 3D car m…
Interpretable Dynamic Graph Neural Networks for Small Occluded Object Detection and Tracking
Department of Computer Science, American International University-Bangladesh（美国国际大学-孟加拉国计算机科学系）；Department of Industrial Engineering and Management, Khulna University of Engineering and Technology (KUET)（Khulna工程与技术大学工业工程与管理系）；Physics and Biology Unit, Okinawa Institute of Science and Technology Graduate University (OIST)（冲绳科学与技术研究生大学物理与生物学单元）
Multi-Agent Object Detection Framework Based on Raspberry Pi YOLO Detector and Slack-Ollama Natural Language Interface
The Institute for Artificial Intelligence Research（人工智能研究机构）；Development of Serbia（塞尔维亚发展）；Department of Power, Electronic and Telecommunication Engineering（电力、电子与电信工程系）；Faculty of Technical Sciences, University of Novi Sad（技术科学学院，诺维萨德大学）；Faculty of Finance, Banking and Auditing, Alfa BK University（金融、银行与审计学院，阿尔法BK大学）
Multiple object tracking (MOT) is an important technology in the field of computer vision, which is widely used in automatic driving, intelligent monitoring, behavior recognition and other directions. Among the current popular MOT methods based on deep learning, Detection Based Tracking (DBT) is the most widely used in industry, and the performance of them depend on their object detection network. At present, the DBT algorithm with good performance and the most widely used is YOLOv5-DeepSORT. Inspired by YOLOv5-DeepSORT, with the proposal of YOLOv7 network, which performs better in object dete…
Fondazione Istituto Italiano di Tecnologia (IIT)（意大利技术研究院）；Istituto per le Applicazioni del Calcolo del Consiglio Nazionale delle Ricerche（意大利国家研究委员会计算应用研究所）；Università degli Studi Roma tre（罗马第三大学）；Polish Academy of Sciences（波兰科学院）；Harvard University（哈佛大学）
Deep neural networks are rapidly emerging as data analysis tools, often outperforming the conventional techniques used in complex microfluidic systems. One fundamental analysis frequently desired in microfluidic experiments is counting and tracking the droplets. Specifically, droplet tracking in dense emulsions is challenging as droplets move in tightly packed configurations. Sometimes the individual droplets in these dense clusters are hard to resolve, even for a human observer. Here, two deep learning-based cutting-edge algorithms for object detection (YOLO) and object tracking (DeepSORT) ar…
National Yang Ming Chiao Tung University（国立阳明交通大学）
We design a fast car detection and tracking algorithm for traffic monitoring fisheye video mounted on crossroads. We use ICIP 2020 VIP Cup dataset and adopt YOLOv5 as the object detection base model. The nighttime video of this dataset is very challenging, and the detection accuracy (AP50) of the base model is about 54%. We design a reliable car detection and tracking algorithm based on the concept of bounding box propagation among frames, which provides 17.9 percentage points (pp) and 6.2 pp. accuracy improvement over the base model for the nighttime and daytime videos, respectively. To speed…
University of Missouri-Columbia（密苏里大学哥伦比亚分校）；WSP USA（WSP美国公司）
The rapid advancement in the field of deep learning and high performance computing has highly augmented the scope of video based vehicle counting system. In this paper, the authors deploy several state of the art object detection and tracking algorithms to detect and track different classes of vehicles in their regions of interest (ROI). The goal of correctly detecting and tracking vehicles' in their ROI is to obtain an accurate vehicle count. Multiple combinations of object detection models coupled with different tracking systems are applied to access the best vehicle counting framework. The …
DefocusTrackerAI -- A Generalized Framework for the Automatic Detection of Defocused Particle Images
IN+ Center for Innovation, Technology and Policy Research, Instituto Superior Técnico, University of Lisbon, Lisbon, Portugal（IN+创新、科技与政策研究中心，理工学院，里斯本大学，里斯本，葡萄牙）；CINAMIL - Military Academy Research Center, Militart Academy, Portugal（CINAMIL - 军事学院研究中心，军事学院，葡萄牙）；Department of Industrial Engineering, Alma Mater Studiorum University of Bologna, Bologna, Italy（工业工程系，博洛尼亚大学，博洛尼亚，意大利）
Fondazione Istituto Italiano di Tecnologia (IIT)（意大利技术研究院）；Istituto Nanoscienze-CNR（意大利国家研究委员会纳米科学研究所）；Scuola Normale Superiore（比萨高等师范学校）；Istituto per le Applicazioni del Calcolo del Consiglio Nazionale delle Ricerche（意大利国家研究委员会计算应用研究所）；Università degli Studi Roma tre（罗马第三大学）；Università di Pisa（比萨大学）
Tracking droplets in microfluidics is a challenging task. The difficulty arises in choosing a tool to analyze general microfluidic videos to infer physical quantities. The state-of-the-art object detector algorithm You Only Look Once (YOLO) and the object tracking algorithm Simple Online and Realtime Tracking with a Deep Association Metric (DeepSORT) are customizable for droplet identification and tracking. The customization includes training YOLO and DeepSORT networks to identify and track the objects of interest. We trained several YOLOv5 and YOLOv7 models and the DeepSORT network for drople…
The use of mobiles phones when driving have been a major factor when it comes to road traffic incidents and the process of capturing such violations can be a laborious task. Advancements in both modern object detection frameworks and high-performance hardware has paved the way for a more automated approach when it comes to video surveillance. In this work, we propose a custom-trained state-of-the-art object detector to work with roadside cameras to capture driver phone usage without the need for human intervention. The proposed approach also addresses the issues caused by windscreen glare and …
Jamoum University College（贾穆姆大学学院）；Umm Al-Qura University（乌姆·库拉大学）；King Abdulaziz University（阿卜杜勒阿齐兹国王大学）
Individual abnormal behaviors vary depending on crowd sizes, contexts, and scenes. Challenges such as partial occlusions, blurring, large-number abnormal behavior, and camera viewing occur in large-scale crowds when detecting, tracking, and recognizing individuals with abnormal behaviors. In this paper, our contribution is twofold. First, we introduce an annotated and labeled large-scale crowd abnormal behaviors Hajj dataset (HAJJv2). Second, we propose two methods of hybrid Convolutional Neural Networks (CNNs) and Random Forests (RFs) to detect and recognize Spatio-temporal abnormal behaviors…
University of Wisconsin-Madison（威斯康星大学麦迪逊分校）；Oak Ridge National Laboratory（橡树岭国家实验室）；University of Oxford（牛津大学）；University of Michigan - Ann Arbor（密歇根大学安娜堡分校）
Videos captured using Transmission Electron Microscopy (TEM) can encode details regarding the morphological and temporal evolution of a material by taking snapshots of the microstructure sequentially. However, manual analysis of such video is tedious, error-prone, unreliable, and prohibitively time-consuming if one wishes to analyze a significant fraction of frames for even videos of modest length. In this work, we developed an automated TEM video analysis system for microstructural features based on the advanced object detection model called YOLO and tested the system on an in-situ ion irradi…
The University of Karachi（卡拉奇大学）；Victoria University（维多利亚大学）
There has been a significant increase in the adoption of technology in cricket recently. This trend has created the problem of duplicate work being done in similar computer vision-based research works. Our research tries to solve one of these problems by segmenting ball deliveries in a cricket broadcast using deep learning models, MobileNet and YOLO, thus enabling researchers to use our work as a dataset for their research. The output from our research can be used by cricket coaches and players to analyze ball deliveries which are played during the match. This paper presents an approach to seg…
Purdue University（普渡大学）；Nanjing University（南京大学）；Adobe Research（奥多比研究院）；University of Wisconsion-Madison（威斯康星大学麦迪逊分校）
Advanced video analytic systems, including scene classification and object detection, have seen widespread success in various domains such as smart cities and autonomous transportation. With an ever-growing number of powerful client devices, there is incentive to move these heavy video analytics workloads from the cloud to mobile devices to achieve low latency and real-time processing and to preserve user privacy. However, most video analytic systems are heavyweight and are trained offline with some pre-defined latency or accuracy requirements. This makes them unable to adapt at runtime in the…
Drones or unmanned aerial vehicles are traditionally used for military missions, warfare, and espionage. However, the usage of drones has significantly increased due to multiple industrial applications involving security and inspection, transportation, research purposes, and recreational drone flying. Such an increased volume of drone activity in public spaces requires regulatory actions for purposes of privacy protection and safety. Hence, detection of illegal drone activities such as boundary encroachment becomes a necessity. Such detection tasks are usually automated and performed by deep l…
BleedOrigin: Dynamic Bleeding Source Localization in Endoscopic Submucosal Dissection via Dual-Stage Detection and Tracking
Department of Electronic Engineering, The Chinese University of Hong Kong（电子工程系，香港中文大学）；The Chinese University of Hong Kong Shenzhen Research Institute（香港中文大学深圳研究院）；Department of Gastroenterology, Qilu Hospital of Shandong University（胃肠病科，山东大学齐鲁医院）；Department of Mechanical Engineering, The University of Hong Kong（机械工程系，香港大学）
