This paper investigates task-oriented communication for edge inference, where a low-end edge device transmits the extracted feature vector of a local data sample to a powerful edge server for processing. It is critical to encode the data into an informative and compact representation for low-latency inference given the limited bandwidth. We propose a learning-based communication scheme that jointly optimizes feature extraction, source coding, and channel coding in a task-oriented manner, i.e., targeting the downstream inference task rather than data reconstruction. Specifically, we leverage an information bottleneck (IB) framework to formalize a rate-distortion tradeoff between the informativeness of the encoded feature and the inference performance. As the IB optimization is computationally prohibitive for the high-dimensional data, we adopt a variational approximation, namely the variational information bottleneck (VIB), to build a tractable upper bound. To reduce the communication overhead, we leverage a sparsity-inducing distribution as the variational prior for the VIB framework to sparsify the encoded feature vector. Furthermore, considering dynamic channel conditions in practical communication systems, we propose a variable-length feature encoding scheme based on dynamic neural networks to adaptively adjust the activated dimensions of the encoded feature to different channel conditions. Extensive experiments evidence that the proposed task-oriented communication system achieves a better rate-distortion tradeoff than baseline methods and significantly reduces the feature transmission latency in dynamic channel conditions.
Whenever communication takes place to fulfil a goal, an effective way to encode the source data to be transmitted is to use an encoding rule that allows the receiver to meet the requirements of the goal. A formal way to identify the relevant information with respect to a goal can be obtained exploiting the information bottleneck (IB) principle. In this paper, we propose a goal-oriented communication system, based on the combination of IB and stochastic optimization. The IB principle is used to design the encoder in order to find an optimal balance between representation complexity and relevanc…
Task-Oriented Communication for Graph Data: A Graph Information Bottleneck Approach
School of Control Science and Engineering, Shandong University（山东大学控制科学与工程学院）；Shandong Key Laboratory of Wireless Communication Technologies, Shandong University（山东大学山东省无线通信技术重点实验室）；Department of Communication Systems, EURECOM（欧洲通信学院）
Token Communication in the Era of Large Models: An Information Bottleneck-Based Approach
State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications（网络与交换技术国家重点实验室，北京邮电大学）；Department of Mathematics and Theories, Peng Cheng Laboratory（数学与理论部，鹏城实验室）；Department of Electronic Engineering, Tsinghua University（电子工程系，清华大学）；Pervasive Communications Center, Purple Mountain Laboratories（感知计算中心，紫金山实验室）；College of Computing and Data Science, Nanyang Technological University（计算与数据科学学院，南洋理工大学）
Semantic communications focus on the transmission of semantic features. In this letter, we consider a task-oriented multi-user semantic communication system for multimodal data transmission. Particularly, partial users transmit images while the others transmit texts to inquiry the information about the images. To exploit the correlation among the multimodal data from multiple users, we propose a deep neural network enabled semantic communication system, named MU-DeepSC, to execute the visual question answering (VQA) task as an example. Specifically, the transceiver for MU-DeepSC is designed an…
Internet of Things (IoT) devices will play an important role in emerging applications, since their sensing, actuation, processing, and wireless communication capabilities stimulate data collection, transmission and decision processes of smart applications. However, new challenges arise from the widespread popularity of IoT devices, including the need for processing more complicated data structures and high dimensional data/signals. The unprecedented volume, heterogeneity, and velocity of IoT data calls for a communication paradigm shift from a search for accuracy or fidelity to semantics extra…
Virginia Tech（弗吉尼亚理工大学）；University of Maryland（马里兰大学）；The Ohio State University（俄亥俄州立大学）
Communications systems to date are primarily designed with the goal of reliable transfer of digital sequences (bits). Next generation (NextG) communication systems are beginning to explore shifting this design paradigm to reliably executing a given task such as in task-oriented communications. In this paper, wireless signal classification is considered as the task for the NextG Radio Access Network (RAN), where edge devices collect wireless signals for spectrum awareness and communicate with the NextG base station (gNodeB) that needs to identify the signal label. Edge devices may not have suff…
Based on the vision on the 6G wireless communication network, i.e., global coverage, all spectrums and all applications, we comprehensively survey 6G related wireless channel measurements, channel characteristics, and channel models for all frequency bands and all scenarios. Millimeter wave (mmWave), terahertz (THz), optical band, satellite, unmanned aerial vehicle (UAV), maritime, underwater acoustic, high-speed train (HST), vehicle-to-vehicle (V2V), massive/ ultra-massive multiple-input multiple-output (MIMO), orbital angular momentum (OAM), and industry Internet of things (IoT) communicatio…
Real-time intelligence applications in Internet of Things (IoT) environment depend on timely data communication. However, it is challenging to transmit and analyse massive data of various modalities. Recently proposed task-oriented communication methods based on deep learning have showed its superiority in communication efficiency. In this paper, we propose a cooperative task-oriented communication method for the transmission of multi-modal data from multiple end devices to a central server. In particular, we use the transmission result of data of one modality, which is with lower rate, to con…
SC-GIR: Goal-oriented Semantic Communication via Invariant Representation Learning
University of Sydney（悉尼大学）；VinUniversity（文大学）；College of Engineering and Computer Science（工程与计算机科学学院）；Trinity College Dublin（都柏林信任学院）；Center for Environmental Intelligence (CEI)（环境智能中心）；School of Computer Science and Statistics（计算机科学与统计学学院）；Department of Intelligent Computing and Data Science（智能计算与数据科学系）；Interdisciplinary Centre for Security, Reliability and Trust (SnT)（安全、可靠与信任跨学科中心）；Memorial University（纪念大学）
Semantic communications utilize the transceiver computing resources to alleviate scarce transmission resources, such as bandwidth and energy. Although the conventional deep learning (DL) based designs may achieve certain transmission efficiency, the uninterpretability issue of extracted features is the major challenge in the development of semantic communications. In this paper, we propose an explainable and robust semantic communication framework by incorporating the well-established bit-level communication system, which not only extracts and disentangles features into independent and semanti…
Task-oriented communication is a new paradigm that aims at providing efficient connectivity for accomplishing intelligent tasks rather than the reception of every transmitted bit. In this paper, a deep learning-based task-oriented communication architecture is proposed where the user extracts, compresses and transmits semantics in an end-to-end (E2E) manner. Furthermore, an approach is proposed to compress the semantics according to their importance relevant to the task, namely, adaptable semantic compression (ASC). Assuming a delay-intolerant system, supporting multiple users indicates a prob…
Virginia Tech（弗吉尼亚理工大学）；University of Maryland（马里兰大学）；The Ohio State University（俄亥俄州立大学）
This paper studies the notion of age in task-oriented communications that aims to execute a task at a receiver utilizing the data at its transmitter. The transmitter-receiver operations are modeled as an encoder-decoder pair that is jointly trained while considering channel effects. The encoder converts data samples into feature vectors of small dimension and transmits them with a small number of channel uses thereby reducing the number of transmissions and latency. Instead of reconstructing input samples, the decoder performs a task, e.g., classification, on the received signals. Applying dif…
Task-oriented image semantic communication is a new communication paradigm, which aims to transmit semantics for artificial intelligent (AI) tasks while ignoring the reconstruction quality of the images. However, in some applications, such as autonomous driving, both image reconstruction quality and the performance of the followed AI tasks must be simultaneously considered. To tackle this challenge, this paper proposes a task-oriented semantic communication scheme with semantic reconstruction (TOSC-SR). Its main goal is to simultaneously minimize pixel-level and task-relevant semantic-level di…
