In 6G wireless networks, multi-modal ML models can be leveraged to enable situation-aware network decisions in dynamic environments. However, trained ML models often fail to generalize under domain shifts when training and test data distributions are different because they often focus on modality-specific spurious features. In practical wireless systems, domain shifts occur frequently due to dynamic channel statistics, moving obstacles, or hardware configuration. Thus, there is a need for learning frameworks that can achieve robust generalization under scarce multi-modal data in wireless networks. In this paper, a novel and data-efficient two-phase learning framework is proposed to improve generalization performance in unseen and unfamiliar wireless environments with minimal amount of multi-modal data. In the first stage, a physics-based loss function is employed to enable each BS to learn the physics underlying its wireless environment captured by multi-modal data. The data-efficiency of the physics-based loss function is analytically investigated. In the second stage, collaborative domain adaptation is proposed to leverage the wireless environment knowledge of multiple BSs to guide under-performing BSs under domain shift. Specifically, domain-similarity-aware model aggregation is proposed to utilize the knowledge of BSs that experienced similar domains. To validate the proposed framework, a new dataset generation framework is developed by integrating CARLA and MATLAB-based mmWave channel modeling to predict mmWave RSS. Simulation results show that the proposed physics-based training requires only 13% of data samples to achieve the same performance as a state-of-the-art baseline that does not use physics-based training. Moreover, the proposed collaborative domain adaptation needs only 25% of data samples and 20% of FLOPs to achieve the convergence compared to baselines.
WiWorld-RealData: A Real-World Multi-Modal Dataset for 6G Wireless World Models
State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications(北京邮电大学网络与交换技术国家重点实验室);China Mobile Research Institute(中国移动研究院)
Vision-Wireless Fusion for Multi-User Localization: A Cross-Modal Transformer Approach
Great Bay University(大湾区大学);Great Bay Institute for Advanced Study (GBIAS)(大湾区高等研究院);Guangdong University of Technology(广东工业大学);Chalmers University of Technology(查尔姆斯理工大学);Khalifa University(哈利法大学)
Distribution-Level AirComp for Wireless Federated Learning under Data Scarcity and Heterogeneity
School of Electronics and Electrical Engineering, Hongik University(弘益大学电子电气工程学院);Department of Electrical and Computer Engineering, Sungkyunkwan University(成均馆大学电气与计算机工程学院)
Map as a Prompt: Learning Multi-Modal Spatial-Signal Foundation Models for Cross-scenario Wireless Localization
Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳));Pengcheng Laboratory(鹏城实验室);Shanghai Academy of AI for Science(上海人工智能科学研究院);Artificial Intelligence Innovation and Incubation Institute, Fudan University(复旦大学人工智能创新与孵化院)
Wireless-Friendly Window Position Optimization for RIS-Aided Outdoor-to-Indoor Networks based on Multi-Modal Large Language Model
Department of Electronic and Electrical Engineering, the University of Sheffield(电子与电气工程系,谢菲尔德大学);Department of Computer Science and Technology, University of Cambridge(计算机科学与技术系,剑桥大学);Brunel University London(伦敦布鲁内尔大学);School of Information and Electronic Engineering, Zhejiang Gongshang University(信息与电子工程学院,浙江工商大学);Design & Health Lab, Department of Architecture, Built Environment and Construction Engineering, Politecnico di Milano(设计与健康实验室,建筑、环境与土木工程系,米兰理工学院);Department of Computer Science, Brunel University London(计算机科学系,伦敦布鲁内尔大学);The State Key Laboratory of Synthetical Automation for Process Industries and The College of Information Science and Engineering, Northeastern University(过程工业综合自动化国家重点实验室和信息科学与工程学院,东北大学);Centre for Wireless Innovation, Queen’s University of Belfast(无线创新中心,贝尔法斯特女王大学)
Environment-Aware Channel Inference via Cross-Modal Flow: From Multimodal Sensing to Wireless Channels
School of Computing Science, University of Glasgow(格拉斯哥大学计算机科学学院);School of Electronics and Computer Science, University of Southampton(南安普顿大学电子与计算机科学学院)
Multimodal-NF: A Wireless Dataset for Near-Field Low-Altitude Sensing and Communications
School of Information Science and Engineering, Southeast University(东南大学信息科学与工程学院);Institute of Communications Engineering, National Sun Yat-sen University(国立中山大学通信工程研究所)
A Sensing Dataset Protocol for Benchmarking and Multi-Task Wireless Sensing
School of Information and Communication Engineering, Beijing University of Posts and Telecommunications(信息与通信工程学院,北京邮电大学);College of Electronics and Information Engineering, Shenzhen University(电子与信息工程学院,深圳大学);Huawei Technology Co. Ltd.(华为技术有限公司);Department of Electronic and Electrical Engineering, University College London(电子与电气工程系,伦敦大学学院)
AI2MMUM: AI-AI Oriented Multi-Modal Universal Model Leveraging Telecom Domain Large Model
Cooperative Medianet Innovation Center, Shanghai Jiao Tong University(上海交通大学 cooperative medianet innovation center);Nokia Bell Labs(诺基亚贝尔实验室);Institute of Intelligent Communications and Network Security, Chongqing University of Posts and Telecommunications(重庆邮电大学智能通信与网络安全研究所)