arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2210.05321cs.NI
收藏

基于车联网的图像分割语义通信

Image Segmentation Semantic Communication over Internet of Vehicles

Qiang Pan, Haonan Tong, Jie Lv, Tao Luo, Zhilong Zhang, Changchuan Yin, Jianfeng Li

摘要:

本文研究了车联网环境下基于语义的高效图像传输问题。在所考虑的模型中,车辆共享其视觉传感器感知到的大量视觉数据,以帮助其他车辆做出驾驶决策。然而,由于有限的频谱资源,很难保持高可靠性的可视数据传输。为了解决这个问题,语义通信的方法,以减少传输的数据量,同时确保语义级的准确性。特别地,提出了一种图像分割语义通信(ISSC)系统,该系统可以从感知图像中提取语义特征,并将这些特征传输到接收车辆,接收车辆重建图像分割。ISSC系统由分别位于发射机和接收机的编码器和解码器组成。为了准确地提取图像语义特征,ISSC系统编码器采用了基于Swin Transformer的多尺度语义特征提取器。在接收端设计了语义特征解码器和重构器,以抵抗无线噪声的干扰并实现图像分割。仿真结果表明,所提出的ISSC系统能够以较高的压缩比准确地重建图像分割,并且能够实现对信道噪声的鲁棒传输性能,特别是在低信噪比(SNR)下。在平均交并比(mIoU)方面,ISSC系统与使用传统编码方法的基线相比可以实现75%的增加

英文摘要:

In this paper, the problem of semantic-based efficient image transmission is studied over the Internet of Vehicles (IoV). In the considered model, a vehicle shares massive amount of visual data perceived by its visual sensors to assist other vehicles in making driving decisions. However, it is hard to maintain a high reliable visual data transmission due to the limited spectrum resources. To tackle this problem, a semantic communication approach is introduced to reduce the transmission data amount while ensuring the semantic-level accuracy. Particularly, an image segmentation semantic communication (ISSC) system is proposed, which can extract the semantic features from the perceived images and transmit the features to the receiving vehicle that reconstructs the image segmentations. The ISSC system consists of an encoder and a decoder at the transmitter and the receiver, respectively. To accurately extract the image semantic features, the ISSC system encoder employs a Swin Transformer based multi-scale semantic feature extractor. Then, to resist the wireless noise and reconstruct the image segmentation, a semantic feature decoder and a reconstructor are designed at the receiver. Simulation results show that the proposed ISSC system can reconstruct the image segmentation accurately with a high compression ratio, and can achieve robust transmission performance against channel noise, especially at the low signal-to-noise ratio (SNR). In terms of mean Intersection over Union (mIoU), the ISSC system can achieve an increase by 75%, compared to the baselines using traditional coding method

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑