This letter presents a novel radar based, single-frame, multi-class detection method for moving road users (pedestrian, cyclist, car), which utilizes low-level radar cube data. The method provides class information both on the radar target- and object-level. Radar targets are classified individually after extending the target features with a cropped block of the 3D radar cube around their positions, thereby capturing the motion of moving parts in the local velocity distribution. A Convolutional Neural Network (CNN) is proposed for this classification step. Afterwards, object proposals are generated with a clustering step, which not only considers the radar targets' positions and velocities, but their calculated class scores as well. In experiments on a real-life dataset we demonstrate that our method outperforms the state-of-the-art methods both target- and object-wise by reaching an average of 0.70 (baseline: 0.68) target-wise and 0.56 (baseline: 0.48) object-wise F1 score. Furthermore, we examine the importance of the used features in an ablation study.
Automatic Road Subsurface Distress Recognition from Ground Penetrating Radar Images using Deep Learning-based Cross-verification
Department of Engineering Mechanics, School of Civil Engineering and Transportation, South China University of Technology(华南理工大学土木工程与交通学院力学系);Guangdong Provincial Academy of Building Research Group Co. Ltd.(广东省建筑科学研究集团有限公司);School of Civil and Transportation Engineering, Guangdong University of Technology(广东工业大学土木与交通学院)
Radar-Based NLoS Pedestrian Localization for Darting-Out Scenarios Near Parked Vehicles with Camera-Assisted Point Cloud Interpretation
Seoul National University(首尔国立大学);Samsung Electro-Mechanics Co., Ltd.(三星机电有限公司);Chungnam National University(全南国立大学);Ajou University(亚运会大学);Institute of Engineering Research at Seoul National University(首尔国立大学工程研究所)
RadarXFormer: Robust Object Detection via Cross-Dimension Fusion of 4D Radar Spectra and Images for Autonomous Driving
Global Institute of Future Technology, Shanghai Jiao Tong University(上海交通大学未来技术全球研究院);School of Automation and Intelligent Sensing, Shanghai Jiao Tong University(上海交通大学自动化与智能感知学院);Key Laboratory of System Control and Information Processing, Ministry of Education of China(中国教育部系统控制与信息处理重点实验室);SAIC GM Wuling Automobile Company Co., Ltd.(上汽通用五菱汽车有限公司);Guangxi Laboratory of New Energy Automobile(广西新能源汽车实验室)
DinoRADE: Full Spectral Radar-Camera Fusion with Vision Foundation Model Features for Multi-class Object Detection in Adverse Weather
Infineon Technologies AG, Austria(英飞凌科技公司,奥地利);Graz University of Technology, Austria(格拉茨技术大学,奥地利);Virtual Vehicle Research GmbH, Austria(虚拟车辆研究有限公司,奥地利)
Eat-Radar: Continuous Fine-Grained Intake Gesture Detection Using FMCW Radar and 3D Temporal Convolutional Network with Attention
KU Leuven(鲁汶大学);Vellore Institute of Technology(韦洛尔理工学院);IMEC(比利时微电子研究中心);Wageningen University and Research(瓦赫宁根大学及研究中心);OnePlanet Research Center(壹行星研究中心)
RADE-Net: Robust Attention Network for Radar-Only Object Detection in Adverse Weather
Infineon Technologies AG(英飞凌科技有限公司);Institute of Visual Computing(视觉计算研究所);Graz University of Technology(格拉茨工业大学);Virtual Vehicle Research GmbH(虚拟车辆研究有限公司)
calibfusion: Transformer-Based Differentiable Calibration for Radar-Camera Fusion Detection in Water-Surface Environments
School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)
Wavelet-based Multi-View Fusion of 4D Radar Tensor and Camera for Robust 3D Object Detection
Thrust of Artificial Intelligence, Hong Kong University of Science and Technology (Guangzhou)(人工智能 thrust,香港科技大学(广州));Momoniai AI;Department of Mechanical Engineering, Massachusetts Institute of Technology(机械工程系,麻省理工学院);School of Information Engineering, Yancheng Institute of Technology(信息工程学院,盐城科技学院);College of Information Science and Electronic Engineering, Zhejiang University(信息科学与电子工程学院,浙江大学);Institute for Math & AI, Wuhan University(数学与人工智能研究所,武汉大学);College of Science and Engineering and the Centre for AI and Data Science Innovation, James Cook University(科学与工程学院及人工智能与数据科学创新中心,詹姆斯库克大学);School of Transportation, Southeast University(交通运输学院,东南大学)
Transfer Learning from Simulated to Real Scenes for Monocular 3D Object Detection
University of Cagliari(卡利亚里大学);Technical University of Munich(慕尼黑工业大学);University of California, Merced(加州大学默塞德分校);Universidad de Las Palmas de Gran Canaria(大加那利岛拉斯帕尔马斯大学);University of California, San Diego(加州大学圣迭戈分校)