用于高效图像传输的位置辅助语义通信:设计、实现与实验结果
Position-Aided Semantic Communication for Efficient Image Transmission: Design, Implementation, and Experimental Results
AI总结:
本文提出融合定位与基础模型的 PASC 框架,利用位置检索地图并生成、校正图像,以提升户外图像语义传输效率和场景鲁棒性。
摘要:
借助知识库(KB)增强的语义通信可大幅降低传输开销并提升抗错能力。然而,现有方法主要依赖端到端训练来构建 KB,往往未能充分利用通信设备上可用的丰富信息。受感知与通信日益融合的启发,我们提出一种新颖的位置辅助语义通信(PASC)框架,将定位融入语义传输。该框架专为基于位置的图像通信而设计,例如户外摄像机视角图像的实时上传。通过利用位置,框架检索相应地图,随后采用先进的基础模型(FM)驱动视角生成器,合成与目标图像高度相似的图像。PASC 框架进一步利用 FM 将合成图像与真实图像之间的偏差进行融合,以增强语义重建。值得注意的是,该框架具有高度灵活性,能够通过一种新颖的基于 FM 的参数优化策略适应动态内容和波动的信道条件。此外,本文还解决了实时部署面临的挑战,并开发硬件测试平台对框架进行验证。仿真和真实世界测试表明,所提出的 PASC 方法不仅显著提升了传输效率,而且在多样且不断变化的传输场景中保持稳健。
英文摘要:
Semantic communication, augmented by knowledge bases (KBs), offers substantial reductions in transmission overhead and resilience to errors. However, existing methods predominantly rely on end-to-end training to construct KBs, often failing to fully capitalize on the rich information available at communication devices. Motivated by the growing convergence of sensing and communication, we introduce a novel Position-Aided Semantic Communication (PASC) framework, which integrates localization into semantic transmission. This framework is particularly designed for position-based image communication, such as real-time uploading of outdoor camera-view images. By utilizing the position, the framework retrieves corresponding maps, and then an advanced foundation model (FM)-driven view generator is employed to synthesize images closely resembling the target images. The PASC framework further leverages the FM to fuse the synthesized image with deviations from the real one, enhancing semantic reconstruction. Notably, the framework is highly flexible, capable of adapting to dynamic content and fluctuating channel conditions through a novel FM-based parameter optimization strategy. Additionally, the challenges of real-time deployment are addressed, with the development of a hardware testbed to validate the framework. Simulations and real-world tests demonstrate that the proposed PASC approach not only significantly boosts transmission efficiency, but also remains robust in diverse and evolving transmission scenarios.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。