Event cameras are a kind of bio-inspired sensors that generate data when the brightness changes, which are of low-latency and high dynamic range (HDR). However, due to the nature of the sparse event stream, event-based mapping can only obtain sparse or semi-dense edge 3D maps. By contrast, standard cameras provide complete frames. To leverage the complementarity of event-based and standard frame-based cameras, we propose a fusion strategy for dense mapping in this paper. We first generate an edge map from events, and then fill the map using frames to obtain the dense depth map. We propose "filling score" to evaluate the quality of filled results and show that our strategy can increase the number of existing semi-dense 3D map.
Cross-Session 3D LiDAR and Camera Fusion for Robust Localization of Unmanned Aerial Vehicles in GPS-Denied Environments
School of Electrical and Data Engineering, University of Technology Sydney(悉尼大学电气与数据工程学院);Institute of Aerospace Engineering and Technology, Duy Tan University(杜益大学航空航天工程与技术学院);College of Engineering and Computer Science, VinUniversity(Vin大学工程与计算机科学学院);Smart Green Transformation Center (GREEN-X), VinUniversity(Vin大学智能绿色转型中心 (GREEN-X));Department of Artificial Intelligence and Robotics, Sejong University(成均馆大学人工智能与机器人系)
Radar Guided Camera Verification for Automatic Emergency Braking Rethinking Object Detection in Radar Camera Fusion
Autonomous Systems Lab, Department of Mechatronics Engineering, SRM Institute of Science and Technology(SRM科学与技术学院机电工程系自主系统实验室);Centre for Electric Mobility, Department of EEE, SRM Institute of Science and Technology(SRM科学与技术学院电气与电子工程系电动出行中心)
An Efficient Probabilistic Solution to Mapping Errors in LiDAR-Camera Fusion for Autonomous Vehicles
Indiana University Purdue University Indianapolis(印第安纳大学与普渡大学印第安纳波利斯联合分校);Purdue University(普渡大学);Toyota Motor Engineering and Manufacturing North America Inc.(丰田汽车工程与制造北美公司)
Radar-Camera Fusion for Object Detection and Semantic Segmentation in Autonomous Driving: A Comprehensive Review
University of Liverpool(利物浦大学);Xi’an Jiaotong-Liverpool University(西交利物浦大学);Institute of Deep Perception Technology, JITRI(江苏省产业技术研究院深度感知技术研究所);XJTLU-JITRI Academy of Industrial Technology(西交利物浦大学-江苏省产业技术研究院工业技术学院)
CramNet: Camera-Radar Fusion with Ray-Constrained Cross-Attention for Robust 3D Object Detection
Waymo(Waymo公司)
稳健的3D目标检测对于安全自动驾驶至关重要。摄像头和雷达传感器是协同作用的,因为它们捕获互补信息,并在不同的环境条件下工作良好。然而,融合相机和雷达数据是具有挑战性的,因为每个传感器都缺乏沿垂直轴的信息,也就是说,相机不知道深度,雷达不知道高度。我们提出了相机-雷达匹配网络CramNet,这是一种有效的方法,可以在联合3D空间中融合相机和雷达的传感器读数。为了更好地利用雷达距离测量相机深度预测,我们提出了一种新的射线约束的交叉注意力机制,解决了相机特征和雷达特征之间的几何对应关系的模糊性。我们的方法支持传感器模态丢失的训练,这导致了强大的3D目标检测,即使当车辆上的摄像头或雷达传感器突然发生故障时。我们证明了我们的融合方法的有效性,通过广泛的实验辐射数据集,为数不多的大规模数据集,提供雷达射频图像之一。我们的方法的仅摄像头变体在Waymo Open Dataset上的单目3D目标检测中实现了具有竞争力的性能。
A Particle Filtering Framework for Integrity Risk of GNSS-Camera Sensor Fusion
Stanford University(斯坦福大学);Georgia Institute of Technology(佐治亚理工学院);Indian Institute of Technology Kanpur(印度理工学院坎普尔分校);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
MSSF: A 4D Radar and Camera Fusion Framework With Multi-Stage Sampling for 3D Object Detection in Autonomous Driving
Department of Electronic Engineering and Information Science, University of Science and Technology of China(电子工程与信息科学系,中国科学技术大学);Ningbo Institute of Digital Twin, Eastern Institute of Technology(宁波数字孪生研究所,东部技术研究所)
WaterScenes: A Multi-Task 4D Radar-Camera Fusion Dataset and Benchmarks for Autonomous Driving on Water Surfaces
University of Liverpool(利物浦大学);Wuhan University of Technology(武汉理工大学);Nantong University(南通大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州))
CLFTv2: Efficient Camera-LiDAR Fusion for Semantic Segmentation via Hierarchical Feature Pyramids
Tallinn University of Technology(塔林理工大学);FinEst Centre for Smart Cities, Tallinn University of Technology(塔林理工大学芬埃斯特智慧城市中心);Universitas Mercatorum(梅尔卡托鲁姆大学)
Deep Sensor Fusion with Pyramid Fusion Networks for 3D Semantic Segmentation
Friedrich-Alexander University (FAU) Erlangen-Nürnberg(埃尔朗根-纽伦堡弗里德里希-亚历山大大学);Karlsruhe Institute of Technology(卡尔斯鲁厄理工学院);Technische Hochschule Ingolstadt(因戈尔施塔特应用技术大学);Research Institute AImotion Bavaria(巴伐利亚AImotion研究所)
Estimation of Closest In-Path Vehicle (CIPV) by Low-Channel LiDAR and Camera Sensor Fusion for Autonomous Vehicle
College of Interdisciplinary(交叉学院);Robotics Engineering(机器人工程学院);Interdisciplinary Engineering, Daegu Gyeongbuk Institute of Science and Technology(DGIST)(大邱庆北科学技术院交叉工程学院)