arXiv 2201.077062022-01-19cs.CVcs.AIcs.LG

Object Detection in Autonomous Vehicles: Status and Open Challenges

Colorado State University（科罗拉多州立大学）

Abhishek Balasubramaniam, Sudeep Pasricha

英文摘要：

Object detection is a computer vision task that has become an integral part of many consumer applications today such as surveillance and security systems, mobile text recognition, and diagnosing diseases from MRI/CT scans. Object detection is also one of the critical components to support autonomous driving. Autonomous vehicles rely on the perception of their surroundings to ensure safe and robust driving performance. This perception system uses object detection algorithms to accurately determine objects such as pedestrians, vehicles, traffic signs, and barriers in the vehicle's vicinity. Deep learning-based object detectors play a vital role in finding and localizing these objects in real-time. This article discusses the state-of-the-art in object detectors and open challenges for their integration into autonomous vehicles.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

Vision-based Navigation of Autonomous Vehicle in Roadway Environments with Unexpected Hazards

Clemson University（克莱姆森大学）

Vision-based navigation of autonomous vehicles primarily depends on the Deep Neural Network (DNN) based systems in which the controller obtains input from sensors/detectors, such as cameras and produces a vehicle control output, such as a steering wheel angle to navigate the vehicle safely in a roadway traffic environment. Typically, these DNN-based systems of the autonomous vehicle are trained through supervised learning; however, recent studies show that a trained DNN-based system can be compromised by perturbation or adversarial inputs. Similarly, this perturbation can be introduced into th…

2019-05-20cs.AIcs.CV

CoFF: Cooperative Spatial Feature Fusion for 3D Object Detection on Autonomous Vehicles

University of North Texas（北德克萨斯大学）；Fujitsu（富士通）

To reduce the amount of transmitted data, feature map based fusion is recently proposed as a practical solution to cooperative 3D object detection by autonomous vehicles. The precision of object detection, however, may require significant improvement, especially for objects that are far away or occluded. To address this critical issue for the safety of autonomous vehicles and human beings, we propose a cooperative spatial feature fusion (CoFF) method for autonomous vehicles to effectively fuse feature maps for achieving a higher 3D object detection performance. Specially, CoFF differentiates w…

2020-09-24cs.CVeess.IV

Online Vehicle Detection For Estimating Traffic Status

Hong Kong Baptist University（香港浸会大学）

We propose a traffic congestion estimation system based on unsupervised on-line learning algorithm. The system does not rely on background extraction or motion detection. It extracts local features inside detection regions of variable size which are drawn on lanes in advance. The extracted features are then clustered into two classes using K-means and Gaussian Mixture Models(GMM). A Bayes classifier is used to detect vehicles according to the previous cluster information which keeps updated whenever system is running by on-line EM algorithm. Experimental result shows that our system can be ada…

2011-07-06cs.CV

Human-Centered Autonomous Vehicle Systems: Principles of Effective Shared Autonomy

Massachusetts Institute of Technology (MIT)（麻省理工学院（MIT））

Building effective, enjoyable, and safe autonomous vehicles is a lot harder than has historically been considered. The reason is that, simply put, an autonomous vehicle must interact with human beings. This interaction is not a robotics problem nor a machine learning problem nor a psychology problem nor an economics problem nor a policy problem. It is all of these problems put into one. It challenges our assumptions about the limitations of human beings at their worst and the capabilities of artificial intelligence systems at their best. This work proposes a set of principles for designing and…

2018-10-03cs.AIcs.CVcs.HC

面向自动驾驶汽车冬季道路安全的基于无人机的智能信息系统

UAV-based Intelligent Information Systems on Winter Road Safety for Autonomous Vehicles

University of Oulu（奥卢大学）

针对冬季恶劣天气下车道宽度受限易引发自动驾驶汽车事故的问题，本研究提出含道路分割与宽度估算模型的方法，从无人机和自动驾驶汽车双视角获取信息，以提升自动驾驶汽车冬季路况下的适应与决策能力。

2024-06-18cs.AIcs.CVcs.RO

Computer Vision for Autonomous Vehicles

Indian Institute of Space Science and Technology（印度空间科学技术学院）

In this work, we try to implement Image Processing techniques in the area of autonomous vehicles, both indoor and outdoor. The challenges for both are different and the ways to tackle them vary too. We also showed deep learning makes things easier and precise. We also made base models for all the problems we tackle while building an autonomous car for Indian Institute of Space science and Technology.

2018-12-06cs.CV

更多相关论文收起更多论文

Improving benchmarks for autonomous vehicles testing using synthetically generated images

AGH University of Technology（AGH科技大学）

Nowadays autonomous technologies are a very heavily explored area and particularly computer vision as the main component of vehicle perception. The quality of the whole vision system based on neural networks relies on the dataset it was trained on. It is extremely difficult to find traffic sign datasets from most of the counties of the world. Meaning autonomous vehicle from the USA will not be able to drive though Lithuania recognizing all road signs on the way. In this paper, we propose a solution on how to update model using a small dataset from the country vehicle will be used in. It is imp…

2019-04-23cs.CVcs.LGcs.RO

基于LiDAR的自动驾驶赛车车辆检测与跟踪

LiDAR-Based Vehicle Detection and Tracking for Autonomous Racing

Politecnico di Milano（米兰理工大学）

本文提出一种基于LiDAR的车辆检测与跟踪流程，包括快速点云分割、车辆姿态估计和变步长多目标跟踪，应用于自动驾驶赛车，实现在超过275公里/小时速度下的自主超车。

2025-01-24cs.CVcs.RO

F-Cooper: Feature based Cooperative Perception for Autonomous Vehicle Edge Computing System Using 3D Point Clouds

University of North Texas（北德克萨斯大学）

Autonomous vehicles are heavily reliant upon their sensors to perfect the perception of surrounding environments, however, with the current state of technology, the data which a vehicle uses is confined to that from its own sensors. Data sharing between vehicles and/or edge servers is limited by the available network bandwidth and the stringent real-time constraints of autonomous driving applications. To address these issues, we propose a point cloud feature based cooperative perception framework (F-Cooper) for connected autonomous vehicles to achieve a better object detection precision. Not o…

2019-09-13cs.CV

Safety-aware Motion Prediction with Unseen Vehicles for Autonomous Driving

HKUST（香港科技大学）；Alexa AI, Amazon（亚马逊Alexa AI）；EPFL（洛桑联邦理工学院）

Motion prediction of vehicles is critical but challenging due to the uncertainties in complex environments and the limited visibility caused by occlusions and limited sensor ranges. In this paper, we study a new task, safety-aware motion prediction with unseen vehicles for autonomous driving. Unlike the existing trajectory prediction task for seen vehicles, we aim at predicting an occupancy map that indicates the earliest time when each location can be occupied by either seen and unseen vehicles. The ability to predict unseen vehicles is critical for safety in autonomous driving. To tackle thi…

2021-09-03cs.CV

Human-vehicle Cooperative Visual Perception for Autonomous Driving under Complex Road and Traffic Scenarios

Tongji University（同济大学）

Human-vehicle cooperative driving has become the critical technology of autonomous driving, which reduces the workload of human drivers. However, the complex and uncertain road environments bring great challenges to the visual perception of cooperative systems. And the perception characteristics of autonomous driving differ from manual driving a lot. To enhance the visual perception capability of human-vehicle cooperative driving, this paper proposed a cooperative visual perception model. 506 images of complex road and traffic scenarios were collected as the data source. Then this paper improv…

2022-04-21cs.CV

A Survey on 3D LiDAR Localization for Autonomous Vehicles

Worcester Polytechnic Institute（伍斯特理工学院）

LiDAR sensors are becoming one of the most essential sensors in achieving full autonomy for self driving cars. LiDARs are able to produce rich, dense and precise spatial data, which can tremendously help in localizing and tracking a moving vehicle. In this paper, we review the latest finding in 3D LiDAR localization for autonomous driving cars, and analyse the results obtained by each method, in an effort to guide the research community towards the path that seems to be the most promising.

2020-11-21cs.CV

The Role of the Hercules Autonomous Vehicle During the COVID-19 Pandemic: An Autonomous Logistic Vehicle for Contactless Goods Transportation

Since early 2020, the coronavirus disease 2019 (COVID-19) has spread rapidly across the world. As at the date of writing this article, the disease has been globally reported in 223 countries and regions, infected over 108 million people and caused over 2.4 million deaths (https://covid19.who.int/, accessed on Feb. 17, 2021). Avoiding person-to-person transmission is an effective approach to control and prevent the pandemic. However, many daily activities, such as transporting goods in our daily life, inevitably involve person-to-person contact. Using an autonomous logistic vehicle to achieve c…

2021-02-17cs.CVcs.RO

A Brief Survey on Autonomous Vehicle Possible Attacks, Exploits and Vulnerabilities

Amrita School of Engineering（阿姆里塔工程学院）；Amrita Vishwa Vidyapeetham（阿姆里塔维迪亚佩瑟姆大学）

Advanced driver assistance systems are advancing at a rapid pace and all major companies started investing in developing the autonomous vehicles. But the security and reliability is still uncertain and debatable. Imagine that a vehicle is compromised by the attackers and then what they can do. An attacker can control brake, accelerate and even steering which can lead to catastrophic consequences. This paper gives a very short and brief overview of most of the possible attacks on autonomous vehicle software and hardware and their potential implications.

2018-10-03cs.CVcs.HCcs.RO

Lane Detection For Prototype Autonomous Vehicle

Istanbul University-Cerrahpasa（伊斯坦布尔大学-切尔拉帕萨校区）

Unmanned vehicle technologies are an area of great interest in theory and practice today. These technologies have advanced considerably after the first applications have been implemented and cause a rapid change in human life. Autonomous vehicles are also a big part of these technologies. The most important action of a driver has to do is to follow the lanes on the way to the destination. By using image processing and artificial intelligence techniques, an autonomous vehicle can move successfully without a driver help. They can go from the initial point to the specified target by applying pre-…

2019-12-11cs.CVcs.RO

FollowMe：自动驾驶场景中的车辆行为预测

FollowMe: Vehicle Behaviour Prediction in Autonomous Vehicle Settings

Meta Reality Labs（元现实实验室）；The University of Texas at Austin（德克萨斯大学奥斯汀分校）；University of Washington（华盛顿大学）

本文提出 FollowMe 数据集和 FollowMe-STGCNN 深度时空图模型，用于在给定领航车路线条件下预测自车轨迹，并通过实验证明该模型能有效捕捉车辆交互，优于现有运动预测方法。

2023-04-12cs.CVcs.RO

Collaborative Perception for Autonomous Driving: Current Status and Future Trend

Perception is one of the crucial module of the autonomous driving system, which has made great progress recently. However, limited ability of individual vehicles results in the bottleneck of improvement of the perception performance. To break through the limits of individual perception, collaborative perception has been proposed which enables vehicles to share information to perceive the environments beyond line-of-sight and field-of-view. In this paper, we provide a review of the related work about the promising collaborative perception technology, including introducing the fundamental concep…

2022-08-22cs.CVcs.RO

V2V-LLM：基于多模态大语言模型的车与车协同自动驾驶

V2V-LLM: Vehicle-to-Vehicle Cooperative Autonomous Driving with Multimodal Large Language Models

NVIDIA；Carnegie Mellon University（卡内基梅隆大学）

本文提出基于多模态大语言模型的V2V-LLM，通过车与车协同感知提升自动驾驶安全性和性能。

2026-02-16cs.CVcs.RO