With automobiles becoming increasingly reliant on sensors to perform various driving tasks, it is important to encode the relevant CAN bus sensor data in a way that captures the general state of the vehicle in a compact form. In this paper, we develop a deep learning-based method, called Drive2Vec, for embedding such sensor data in a low-dimensional yet actionable form. Our method is based on stacked gated recurrent units (GRUs). It accepts a short interval of automobile sensor data as input and computes a low-dimensional representation of that data, which can then be used to accurately solve a range of tasks. With this representation, we (1) predict the exact values of the sensors in the short term (up to three seconds in the future), (2) forecast the long-term average values of these same sensors, (3) infer additional contextual information that is not encoded in the data, including the identity of the driver behind the wheel, and (4) build a knowledge base that can be used to auto-label data and identify risky states. We evaluate our approach on a dataset collected by Audi, which equipped a fleet of test vehicles with data loggers to store all sensor readings on 2,098 hours of driving on real roads. We show in several experiments that our method outperforms other baselines by up to 90%, and we further demonstrate how these embeddings of sensor data can be used to solve a variety of real-world automotive applications.
Multi-Modal Sensor Fusion for Proactive Blockage Prediction in mmWave Vehicular Networks
Department of Electrical and Computer Engineering, Iowa State University of Science and Technology(电气与计算机工程系,爱荷华州立大学);Computer, Electrical, and Mathematical Sciences & Engineering (CEMSE) Division at King Abdullah University of Science and Technology (KAUST)(国王 Abdullah 科学与技术大学(KAUST)计算机、电气和数学科学与工程(CEMSE)系)
SenseMag: Enabling Low-Cost Traffic Monitoring using Non-invasive Magnetic Sensing
Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);University of Chinese Academy of Sciences(中国科学院大学);Baidu Inc.(百度公司);Peking University(北京大学);Zhejiang Lab(之江实验室);University of Macau(澳门大学)
Optimizing Age of Information in Vehicular Edge Computing with Federated Graph Neural Network Multi-Agent Reinforcement Learning
School of Internet of Things Engineering, Jiangnan University(江南大学物联网工程学院);Tsinghua University(清华大学);Xidian University(西安电子科技大学);Shanghai Jiao Tong University(上海交通大学);University of Kent(肯特大学);Hong Kong University of Science and Technology(香港科技大学)
Cheap2Rich: A Multi-Fidelity Framework for Data Assimilation and System Identification of Multiscale Physics -- Rotating Detonation Engines
Department of Electrical;Computer Engineering, University of Washington, Seattle, USA;Department of Applied Mathematics, University of Washington, Seattle, USA;University of Michigan, Advanced Propulsion Concepts Lab, Ann Arbor, USA;Department of Mathematics, Swiss Federal Institute of Technology Zurich, Zurich, Switzerland
Federated Deep Learning Meets Autonomous Vehicle Perception: Design and Verification
Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));University of New South Wales(新南威尔士大学);Weizmann Institute of Science(魏茨曼科学研究所);Princeton University(普林斯顿大学);Southern University of Science and Technology(南方科技大学);Shenzhen Research Institute of Trustworthy Autonomous Systems(深圳市可信自主系统研究院);University of Macau(澳门大学)