This paper studies the reliability of a real-world learning-enabled system, which conducts dynamic vehicle tracking based on a high-resolution wide-area motion imagery input. The system consists of multiple neural network components -- to process the imagery inputs -- and multiple symbolic (Kalman filter) components -- to analyse the processed information for vehicle tracking. It is known that neural networks suffer from adversarial examples, which make them lack robustness. However, it is unclear if and how the adversarial examples over learning components can affect the overall system-level reliability. By integrating a coverage-guided neural network testing tool, DeepConcolic, with the vehicle tracking system, we found that (1) the overall system can be resilient to some adversarial examples thanks to the existence of other components, and (2) the overall system presents an extra level of uncertainty which cannot be determined by analysing the deep learning components only. This research suggests the need for novel verification and validation methods for learning-enabled systems.
Each human face is unique. It has its own shape, topology, and distinguishing features. As such, developing and testing facial tracking systems are challenging tasks. The existing face recognition and tracking algorithms in Computer Vision mainly specify concrete situations according to particular goals and applications, requiring validation methodologies with data that fits their purposes. However, a database that covers all possible variations of external and factors does not exist, increasing researchers' work in acquiring their own data or compiling groups of databases. To address this sho…
Towards AI enabled automated tracking of multiple boxers
Indian Institute of Technology Madras（印度马德拉斯理工学院）；Indian Institute of Technology Gandhinagar（印度甘地讷格尔理工学院）；Liverpool John Moores University（利物浦约翰摩尔大学）；Inspire Institute of Technology（因斯派尔理工学院）
IBM Research（IBM研究）；Almaden Research Center（阿尔马登研究中心）；Department of Radiology and Imaging Sciences, Emory University（埃默里大学放射与影像科学系）；Emory University（埃默里大学）
We developed a rich dataset of Chest X-Ray (CXR) images to assist investigators in artificial intelligence. The data were collected using an eye tracking system while a radiologist reviewed and reported on 1,083 CXR images. The dataset contains the following aligned data: CXR image, transcribed radiology report text, radiologist's dictation audio and eye gaze coordinates data. We hope this dataset can contribute to various areas of research particularly towards explainable and multimodal deep learning / machine learning methods. Furthermore, investigators in disease classification and localiza…
Singapore University of Technology and Design（新加坡科技设计大学）
The empowering unmanned aerial vehicles (UAVs) have been extensively used in providing intelligence such as target tracking. In our field experiments, a pre-trained convolutional neural network (CNN) is deployed at the UAV to identify a target (a vehicle) from the captured video frames and enable the UAV to keep tracking. However, this kind of visual target tracking demands a lot of computational resources due to the desired high inference accuracy and stringent delay requirement. This motivates us to consider offloading this type of deep learning (DL) tasks to a mobile edge computing (MEC) se…
Development of a Realistic Crowd Simulation Environment for Fine-grained Validation of People Tracking Methods
Silesian University of Technology（西里西亚工业大学）；Institute of Information Science and Technologies, National Research Council（国家研究委员会信息科学与技术研究所）；QSystems.pro sp. z o.o.（QSystems.pro有限责任公司）；Blees sp. z o.o.（Blees有限责任公司）；Silesian University（西里西亚大学）
本文基于 Unity 3D 开发人群仿真扩展 CrowdSim2，通过增强环境、天气、交通和智能体运动真实性生成数据集，并利用 IOU-Tracker、Deep-Sort 与 Deep-TAMA 验证其用于人员跟踪算法评估的可用性。
Longitudinal tracking of multiple sclerosis lesions in the spinal cord: A validation study
Polytechnique Montreal（蒙特利尔理工学院）；TUM University Hospital（慕尼黑工业大学附属医院）；University of British Columbia（不列颠哥伦比亚大学）；University of Calgary（卡尔加里大学）；University of Toronto（多伦多大学）；Université de Montréal（蒙特利尔大学）；University of Alberta（阿尔伯塔大学）
Bridging the Markerless Tracking Validation Gap: Intraoperative X-ray Workflow Integration
The Hamlyn Centre for Robotic Surgery, Imperial College London（伦敦帝国理工学院哈姆林外科机器人中心）；Imperial College Healthcare NHS Trust（帝国理工学院医疗保健 NHS 信托基金）；Stanford University School of Medicine（斯坦福大学医学院）
National Center for Tumor Diseases (NCT)（国家肿瘤疾病中心（NCT））；Intuitive Surgical（直觉外科公司）；Université Grenoble Alpes（格勒诺布尔阿尔卑斯大学）；CNRS（法国国家科学研究中心）；CHU Grenoble Alpes（格勒诺布尔阿尔卑斯大学医院）；Grenoble INP（格勒诺布尔综合理工学院）；TIMC-IMAG（TIMC-IMAG实验室）；Centre for Medical Image Computing（医学影像计算中心）；University College London（伦敦大学学院）；Department of General, Visceral and Transplant Surgery, University of Heidelberg（海德堡大学普通、内脏和移植外科系）；ARTORG Center, University of Bern（伯尔尼大学ARTORG中心）；Computer Aided Medical Procedures, Johns Hopkins University（约翰霍普金斯大学计算机辅助医疗程序）；Institute for Anthropomatics and Robotics, Karlsruhe Institute of Technology (KIT)（卡尔斯鲁厄理工学院（KIT）人机工程与机器人研究所）
Intraoperative segmentation and tracking of minimally invasive instruments is a prerequisite for computer- and robotic-assisted surgery. Since additional hardware like tracking systems or the robot encoders are cumbersome and lack accuracy, surgical vision is evolving as promising techniques to segment and track the instruments using only the endoscopic images. However, what is missing so far are common image data sets for consistent evaluation and benchmarking of algorithms against each other. The paper presents a comparative validation study of different vision-based methods for instrument s…
This paper presents F-Siamese Tracker, a novel approach for single object tracking prominently characterized by more robustly integrating 2D and 3D information to reduce redundant search space. A main challenge in 3D single object tracking is how to reduce search space for generating appropriate 3D candidates. Instead of solely relying on 3D proposals, firstly, our method leverages the Siamese network applied on RGB images to produce 2D region proposals which are then extruded into 3D viewing frustums. Besides, we perform an online accuracy validation on the 3D frustum to generate refined poin…
The Second Hospital of Shandong University, Shandong University（山东大学第二医院，山东大学）；Shenzhen Third People’s Hospital, the Second Affiliated Hospital of Southern University of Science and Technology（深圳市第三人民医院，南方科技大学第二附属医院）；The First Affiliated Hospital of Hainan Medical University（海南医科大学第一附属医院）；Wuhan Asia General Hospital（武汉亚洲总医院）；Shanxi Medical University（山西医科大学）；Chengdu First People’s Hospital（成都市第一人民医院）；Keck School of Medicine, University of Southern California（南加州大学凯克医学院）；Shandong Provincial Hospital Affiliated to Shandong First Medical University（山东第一医科大学附属山东省立医院）
Despite high global prevalence of hepatic steatosis, no automated diagnostics demonstrated generalizability in detecting steatosis on multiple international datasets. Traditionally, hepatic steatosis detection relies on clinicians selecting the region of interest (ROI) on computed tomography (CT) to measure liver attenuation. ROI selection demands time and expertise, and therefore is not routinely performed in populations. To automate the process, we validated an existing artificial intelligence (AI) system for 3D liver segmentation and used it to purpose a novel method: AI-ROI, which could au…
Laboratoire des Sciences du Numérique de Nantes (LS2N)（南特数字科学实验室（LS2N））；École Centrale de Nantes（南特中央理工学院）
Multi-object tracking (MOT) is an integral part of any autonomous driving pipelines because itproduces trajectories which has been taken by other moving objects in the scene and helps predicttheir future motion. Thanks to the recent advances in 3D object detection enabled by deep learning,track-by-detection has become the dominant paradigm in 3D MOT. In this paradigm, a MOT systemis essentially made of an object detector and a data association algorithm which establishes track-to-detection correspondence. While 3D object detection has been actively researched, associationalgorithms for 3D MOT …
Situation-aware technologies enabled by multiobject tracking (MOT) methods will create new services and applications in fields such as autonomous navigation and applied ocean sciences. Belief propagation (BP) is a state-of-the-art method for Bayesian MOT but fully relies on a statistical model and preprocessed sensor measurements. In this paper, we establish a hybrid method for model-based and data-driven MOT. The proposed neural enhanced belief propagation (NEBP) approach complements BP by information learned from raw sensor data with the goal to improve data association and to reject false a…
Korea University of Science and Technology (UST)（韩国科学技术联合大学院大学）；Korea Institute of Science and Technology Information (KISTI)（韩国科学技术信息研究院）
Advances in remote sensing technologies have made it possible to use high-resolution visual data for weather observation and forecasting tasks. We propose the use of multi-layer neural networks for understanding complex atmospheric dynamics based on multichannel satellite images. The capability of our model was evaluated by using a linear regression task for single typhoon coordinates prediction. A specific combination of models and different activation policies enabled us to obtain an interesting prediction result in the northeastern hemisphere (ENH).
Development of computing power and cheap video cameras enabled today's traffic management systems to include more cameras and computer vision applications for transportation system monitoring and control. Combined with image processing algorithms cameras are used as sensors to measure road traffic parameters like flow volume, origin-destination matrices, classify vehicles, etc. In this paper we propose a system for measurement of road traffic parameters (basic motion model parameters and macro-scopic traffic parameters). The system is based on Local Binary Pattern (LBP) image features classifi…
