arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.21092cs.NI
收藏

生成式人工智能辅助的多模态语义提取用于基于NOMA的图像传输

Generative Artificial Intelligence Assisted Multi-modal Semantic Extraction for NOMA-based Image Transmissions

School of Intelligent Systems Engineering, Sun Yat-sen University(中山大学智能系统工程学院);Department of Electrical and Electronic Engineering, University of Hong Kong(香港大学电气电子工程学系);School of Electronics, Electrical Engineering and Computer Science (EEECS), Queen’s University Belfast(贝尔法斯特女王大学电子、电气工程和计算机科学学院);School of Information Management, Jiangxi University of Finance and Economics(江西财经大学信息管理学院)

Songhan Zhao, Shimin Gong, Bo Gu, Hongyang Du, Xidong Mu, Zehui Xiong, Yuming Fang

AI总结:

本文提出利用生成式人工智能辅助的多模态语义提取方法,结合NOMA技术优化图像传输,通过联合优化语义特征选择和传输控制提升恢复性能与传输效率。

摘要:

本文研究了一种生成式人工智能(GAI)辅助的语义通信框架,用于基于非正交多址接入(NOMA)的图像传输。语义用户(SUs)从原始图像中提取跨模态语义特征,然后利用GAI模型进行图像恢复。GAI增强了语义图像传输的泛化能力和恢复能力,而NOMA根据用户交通需求高效分配传输容量。因此,语义提取和传输控制共同影响语义恢复性能和传输开销。通过联合优化语义层面的语义特征选择以及传输层面的接收波束成形和NOMA解码顺序,最大化传输延迟和语义恢复准确率的加权性能。为减少语义特征中的潜在冗余并提高优化效率,我们开发了重要性感知和模型驱动的近端策略优化(IM-PPO)框架。具体而言,我们量化并保留高重要性语义特征以提高PPO的学习效率,同时利用模型驱动优化方法来适应传输控制变量。数值结果验证了语义特征选择和传输控制的联合调整显著提高了语义恢复准确率和传输延迟性能。此外,IM-PPO框架相比基准方法更有效地利用模型信息提高学习效率。

英文摘要:

In this paper, we investigate a generative artificial intelligence (GAI)-assisted semantic communication framework for non-orthogonal multiple access (NOMA)-based image transmissions. Semantic users (SUs) extract cross-modal semantic features from the raw images, which are then used for image recovery by leveraging a GAI model. The GAI enhances the generalization and recovery of semantic image transmissions, while NOMA efficiently allocates transmission capacities to SUs based on their traffic demands. Thus, the semantic extraction and transmission control jointly affect both semantic recovery performance and transmission overhead. We maximize a weighted performance of transmission latency and semantic recovery accuracy by jointly optimizing the semantic feature selection at the semantic level, as well as the receive beamforming and NOMA decoding order at the transmission level. To reduce potential redundancy in semantic features and improve optimization efficiency, we develop an importance-aware and model-driven proximal policy optimization (IM-PPO) framework. Specifically, we quantify and retain high-importance semantic features to enhance the learning efficiency of PPO, while model-based optimization methods are used to adapt the transmission control variables. Numerical results validate that the joint adjustment of the semantic feature selection and the transmission control significantly improves the semantic recovery accuracy and the transmission latency performance. Moreover, the IM-PPO framework effectively leverages the model information to improve the learning efficiency compared to benchmark methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑