arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2511.03220eess.SP
收藏

多模态无线:一种大规模数据集用于传感与通信

Multimodal-Wireless: A Large-Scale Dataset for Sensing and Communication

Southeast University(东南大学);Purple Mountain Laboratories(紫金山实验室);University of California, Santa Cruz(加州大学圣克鲁兹分校);Imperial College London(帝国理工学院)

Tianhao Mao, Le Liang, Jie Yang, Hao Ye, Shi Jin, Geoffrey Ye Li

AI总结:

本文提出多模态无线数据集,用于多模态传感与通信研究,包含高分辨率CSI与多种传感器数据,支持通信与协同感知应用。

摘要:

本文介绍了Multimodal-Wireless,一种用于多模态传感和通信研究的大型开源数据集。该数据集通过基于CARLA模拟器和Sionna框架构建的集成且可定制的数据管道生成,其特征是高分辨率的通信信道状态信息(CSI)与五种其他传感器模态,即激光雷达、RGB和深度相机、惯性测量单元(IMU)和雷达,均以100Hz的采样率完全同步。它包含约160,000帧数据,覆盖四个虚拟城镇、十六种通信场景和三种天气条件。本文全面概述了该数据集,阐述了其关键特性、整体框架和技术实现细节。此外,它探讨了通信和协同感知方面的潜在研究应用,例如使用多模态大语言模型进行波束预测。该数据集可在https://le-liang.github.io/mmw/上公开。

英文摘要:

This paper presents Multimodal-Wireless, a large-scale open-source dataset for multimodal sensing and communication research. The dataset is generated through an integrated and customizable data pipeline built upon the CARLA simulator and Sionna framework, and features high-resolution communication channel state information (CSI) fully synchronized with five other sensor modalities, namely LiDAR, RGB and depth camera, inertial measurement unit (IMU) and radar, all sampled at 100 Hz. It contains approximately 160,000 frames collected across four virtual towns, sixteen communication scenarios, and three weather conditions. This paper provides a comprehensive overview of the dataset, outlining its key features, overall framework, and technical implementation details. In addition, it explores potential research applications concerning communication and collaborative perception, exemplified by beam prediction using a multimodal large language model. The dataset is open in https://le-liang.github.io/mmw/.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑