RF-GPT:教AI看见无线世界
RF-GPT: Teaching AI to See the Wireless World
AI总结:
RF-GPT通过多模态LLM的视觉编码器处理RF频谱图,实现射频信号的高级推理与生成,无需人工标注即可在多个无线任务中取得优异表现。
摘要:
大型语言模型(LLMs)和多模态模型已成为强大的通用推理系统。然而,支撑无线系统的射频(RF)信号仍然未被这些模型原生支持。现有的基于LLM的电信方法主要关注文本和结构化数据,而传统的RF深度学习模型是为特定信号处理任务单独构建的,凸显了RF感知与高级推理之间的明显差距。为此,我们引入了RF-GPT,一种利用多模态LLM的视觉编码器来处理和理解RF频谱图的射频语言模型(RFLM)。在该框架中,复杂的同相/正交(IQ)波形被映射到时频频谱图,然后传递给预训练的视觉编码器。所得表示被注入到解码器-only的LLM中,以生成基于RF的答案、解释和结构化输出。为了训练RF-GPT,我们使用完全合成的RF语料库对预训练的多模态LLM进行监督指令微调。符合标准的波形生成器为六种无线技术生成宽带场景,从中推导出时频频谱图、精确的配置元数据和密集的描述。一个纯文本LLM将这些描述转换为基于RF的指令-答案对,生成大约12000个RF场景和0.625百万条指令示例,无需任何人工标注。在宽带调制分类、重叠分析、无线技术识别、WLAN用户计数和5G NR信息提取等基准测试中,RF-GPT实现了强大的多任务性能,而没有RF接地的一般用途视觉语言模型大多失败。
英文摘要:
Large language models (LLMs) and multimodal models have become powerful general-purpose reasoning systems. However, radio-frequency (RF) signals, which underpin wireless systems, are still not natively supported by these models. Existing LLM-based approaches for telecom focus mainly on text and structured data, while conventional RF deep-learning models are built separately for specific signal-processing tasks, highlighting a clear gap between RF perception and high-level reasoning. To bridge this gap, we introduce RF-GPT, a radio-frequency language model (RFLM) that utilizes the visual encoders of multimodal LLMs to process and understand RF spectrograms. In this framework, complex in-phase/quadrature (IQ) waveforms are mapped to time-frequency spectrograms and then passed to pretrained visual encoders. The resulting representations are injected as RF tokens into a decoder-only LLM, which generates RF-grounded answers, explanations, and structured outputs. To train RF-GPT, we perform supervised instruction fine-tuning of a pretrained multimodal LLM using a fully synthetic RF corpus. Standards-compliant waveform generators produce wideband scenes for six wireless technologies, from which we derive time-frequency spectrograms, exact configuration metadata, and dense captions. A text-only LLM then converts these captions into RF-grounded instruction-answer pairs, yielding roughly 120,000 RF scenes and 0.625 million instruction examples without any manual labeling. Across benchmarks for wideband modulation classification, overlap analysis, wireless-technology recognition, WLAN user counting, and 5G NR information extraction, RF-GPT achieves strong multi-task performance, whereas general-purpose VLMs with no RF grounding largely fail.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。