We consider a system model comprised of an access point (AP) and K Internet of Things (IoT) nodes that sporadically become active in order to send data to the AP. The AP is assumed to have N time-frequency resource blocks that it can allocate to the IoT nodes that wish to send data, where N < K. The main problem is how to allocate the N time-frequency resource blocks to the IoT nodes in each time slot such that the average packet rate is maximized. For this problem, we propose a deep reinforcement learning (DRL)-aided random access (RA) scheme, where an intelligent DRL agent at the AP learns to predict the activity of the IoT nodes in each time slot and grants time-frequency resource blocks to the IoT nodes predicted as active. Next, the IoT nodes that are missclassified as non-active by the DRL agent, as well as unseen or newly arrived nodes in the cell, employ the standard RA scheme in order to obtain time-frequency resource blocks. We leverage expert knowledge for faster training of the DRL agent. Our numerical results show significant improvements in terms of average packet rate when the proposed DRL-aided RA scheme is implemented compared to the existing solution used in practice, the standard RA scheme.
This paper presents a data-aided channel estimator that reduces the channel estimation error of the conventional linear minimum-mean-squared-error (LMMSE) method for multiple-input multiple-output communication systems. The basic idea is to selectively exploit detected symbol vectors obtained from data detection as additional pilot signals. To optimize the selection of the detected symbol vectors, a Markov decision process (MDP) is defined which finds the best selection to minimize the mean-squared-error (MSE) of the channel estimate. Then a reinforcement learning algorithm is developed to sol…
In this paper, we study the transmission design for reconfigurable intelligent surface (RIS)-aided multiuser communication networks. Different from most of the existing contributions, we consider long-term CSI-based transmission design, where both the beamforming vectors at the base station (BS) and the phase shifts at the RIS are designed based on long-term CSI, which can significantly reduce the channel estimation overhead. Due to the lack of explicit ergodic data rate expression, we propose a novel deep deterministic policy gradient (DDPG) based algorithm to solve the optimization problem, …
We consider an Intelligent Reflecting Surface (IRS)-aided multiple-input single-output (MISO) system for downlink transmission. We compare the performance of Deep Reinforcement Learning (DRL) and conventional optimization methods in finding optimal phase shifts of the IRS elements to maximize the user signal-to-noise (SNR) ratio. Furthermore, we evaluate the robustness of these methods to channel impairments and changes in the system. We demonstrate numerically that DRL solutions show more robustness to noisy channels and user mobility.
This letter considers temporal-correlated massive access, where each device, once activated, is likely to transmit continuously over several consecutive frames. Motivated by that the device activity at each frame is correlated to not only its previous frame but also its next frame, we propose a double-sided information (DSI) aided joint activity detection and channel estimation algorithm based on the approximate message passing (AMP) framework. The DSI is extracted from the estimation results in a sliding window that contains the target detection frame and its previous and next frames. The pro…
In this paper, we investigate a reconfigurable intelligent surface (RIS)-aided multiuser full-duplex secure communication system with hardware impairments at transceivers and RIS, where multiple eavesdroppers overhear the two-way transmitted signals simultaneously, and an RIS is applied to enhance the secrecy performance. Aiming at maximizing the sum secrecy rate (SSR), a joint optimization problem of the transmit beamforming at the base station (BS) and the reflecting beamforming at the RIS is formulated under the transmit power constraint of the BS and the unit modulus constraint of the phas…
Wireless network optimization has been becoming very challenging as the problem size and complexity increase tremendously, due to close couplings among network entities with heterogeneous service and resource requirements. By continuously interacting with the environment, deep reinforcement learning (DRL) provides a mechanism for different network entities to build knowledge and make autonomous decisions to improve network performance. In this article, we first review typical DRL approaches and recent enhancements. We then discuss the applications of DRL for mobile edge computing (MEC), which …
Research Center for Information Technology Innovation, Academia Sinica（中央研究院资讯科技创新研究中心）
This paper proposes a novel multiple-input multiple-output (MIMO) symbol detector that incorporates a deep reinforcement learning (DRL) agent into the Monte Carlo tree search (MCTS) detection algorithm. We first describe how the MCTS algorithm, used in many decision-making problems, is applied to the MIMO detection problem. Then, we introduce a self-designed deep reinforcement learning agent, consisting of a policy value network and a state value network, which is trained to detect MIMO symbols. The outputs of the trained networks are adopted into a modified MCTS detection algorithm to provide…
This paper considers a two-user downlink transmission in intelligent reflecting surface (IRS) aided network over fading channels. Particularly, non-orthogonal multiple access (NOMA) and two orthogonal multiple access (OMA) schemes, namely, time division multiple access (TDMA) and frequency division multiple access (FDMA), are studied. The objective is to maximize the system average sum rate for the delay-tolerant transmission. We propose two adjustment schemes, namely, dynamic phase adjustment and one-time phase adjustment. The power budget, minimum average data rate, and discrete unit modulus…
In this paper, we investigate rate splitting multiple access (RSMA) aided mobile edge computing (MEC) in a cognitive radio network. We propose a RSMA scheme that enables the secondary user to offload tasks to the MEC server utilizing dynamic rate splitting without deteriorating the primary user's offloading. The expressions for the optimal rate splitting parameters that maximize the achievable rate for the secondary user and successful computation probability of the proposed RSMA scheme are derived in closed-form. We formulate a problem to maximize successful computation probability by jointly…
In this letter, we study a rate-splitting multiple access (RSMA)-based intelligent reflecting surface (IRS)-aided multi-user multiple-input single-output (MISO) secure communication system with a potential eavesdropper (Eve). Aiming to maximize the minimum secrecy rate (SR) among all the legitimate users (LUs), a design problem for jointly optimizing the transmit beamforming with artificial noise (AN), the IRS beamforming, and the secrecy common rate allocation is formulated. Since the design problem is highly non-convex with coupled optimization variables, we develop a computationally efficie…
Intelligent reflecting surface (IRS) is a new promising technology that is able to manipulate the wireless propagation channel via smart and controllable signal reflection. In this paper, we investigate the capacity region of a multiple access channel (MAC) with two users sending independent messages to an access point (AP), aided by $M$ IRS reflecting elements. We consider two practical IRS deployment strategies that lead to different user-AP effective channels, namely, the distributed deployment where the $M$ reflecting elements form two IRSs, each deployed in the vicinity of one user, versu…
In this paper, we focus on the optimal beamformer design for rate splitting multiple access (RSMA)-aided multipleinput single-output (MISO) visible light communication (VLC) networks. First, we derive the closed-form lower bounds of the achievable rate of each user, which are the first theoretical bound of achievable rate for RSMA-aided VLC networks. Second, we investigate the optimal beamformer design for RSMA-aided VLC networks to maximize the sum rate under the optical and electrical power constraints. In addition, we show that the proposed RSMA-aided networks can achieve superior performan…
In this paper, data-aided sensing as a cross-layer approach in Internet-of-Things (IoT) applications is studied, where multiple IoT nodes collect measurements and transmit them to an Access Point (AP). It is assumed that measurements have a sparse representation (due to spatial correlation) and the notion of Compressive Sensing (CS) can be exploited for efficient data collection. For data-aided sensing, a node selection criterion is proposed to efficiently reconstruct a target signal through iterations with a small number of measurements from selected nodes. Together with Compressive Random Ac…
In the Internet-of-Things (IoT), random access is employed for devices to share a common access channel in packet transmission with low signaling overhead. Although a retransmission strategy is necessary for packet collision resolution, it might be prohibitive for some devices due to energy and complexity constraints. In this paper, we consider a novel relay-aided random access (RARA) scheme where re-transmissions are carried out by relay nodes, not devices. Thanks to multipacket reception with multiple copies of collided signals forwarded by relay nodes, a receiver is able to recover multiple…
This letter is the third part of a three-part tutorial that focuses on rate-splitting multiple access (RSMA) for 6G. As Part III of the tutorial, this letter provides an overview of integrating RSMA and reconfigurable intelligent surface (RIS). We first introduce two potential PHY layer techniques, namely, RSMA and RIS, including the need for integrating RSMA with RIS and how they could help each other. Next, we provide a general model of an RIS-aided RSMA system and summarize some key performance metrics. Then, we discuss the major advantages of RIS-aided RSMA networks, and illustrate the rat…
In this paper, we propose a novel joint caching and non-orthogonal multiple access (NOMA) scheme to facilitate advanced downlink transmission for next generation cellular networks. In addition to reaping the conventional advantages of caching and NOMA transmission, the proposed cache-aided NOMA scheme also exploits cached data for interference cancellation which is not possible with separate caching and NOMA transmission designs. Furthermore, as caching can help to reduce the residual interference power, several decoding orders are feasible at the receivers, and these decoding orders can be fl…
Rate-splitting multiple access (RSMA) has been recognized as a promising and powerful multiple access (MA) scheme, non-orthogonal transmission framework and interference management strategy for 6G. Inspired by the appealing spectral efficiency gain achieved by RSMA over conventional MA schemes in multi-user multi-antenna transmission, in this paper we introduce RSMA to reconfigurable intelligent surface (RIS)-aided multiple-input single-out (MISO) broadcast channel (BC). To further enhance the spectral efficiency, a more generalized RIS architecture called fully connected RIS is considered. By…
In this paper, a novel spatial modulation aided non-orthogonal multiple access (SM-NOMA) system is proposed. We use mutual information (MI) to characterize the achievable spectral efficiency (SE) of the proposed SM-NOMA system. Due to the finite-alphabet space-domain inputs employed by SM, the expression of the corresponding MI lacks a closed-form formulation. Hence, a lower bound is proposed to quantify the MI of the SM-NOMA system. Furthermore, its asymptotic property is also theoretically investigated in both low and high signal-to-noise ratio (SNR) regions. The SE performance and its analy…
In this paper, we study data-aided sensing (DAS) for a system consisting of a base station (BS) and a number of nodes, where the BS becomes a receiver that collects measurements or data sets from the nodes that are distributed over a cell. DAS is an iterative data collection scheme that allows the BS to efficiently estimate a target signal (i.e., all nodes' measurements) with a small number of measurements (compared to random polling). In DAS, a set of nodes are selected in each round based on the data sets that are already available at the BS from previous rounds for efficient data collection…
In the upcoming Internet-of-Things (IoT) era, the communication is often featured by massive connection, sporadic transmission, and small-sized data packets, which poses new requirements on the delay expectation and resource allocation efficiency of the Random Access (RA) mechanisms of the IoT communication stack. A grant-free non-orthogonal random access (NORA) system is considered in this paper, which could simultaneously reduce the access delay and support more Machine Type Communication (MTC) devices with limited resources. In order to address the joint user activity detection (UAD) and ch…
The increasing demand for rich multimedia services and the emergence of the Internet-of-Things (IoT) pose challenging requirements for the next generation vehicular networks. Such challenges are largely related to high spectral efficiency and low latency requirements in the context of massive content delivery and increased connectivity. In this respect, caching and non-orthogonal multiple access (NOMA) paradigms have been recently proposed as potential solutions to effectively address some of these key challenges. In the present contribution, we introduce cache-aided NOMA as an enabling techno…
IRIDA Research Centre for Communication Technologies（IRIDA通信技术研究中心）；University of Cyprus（塞浦路斯大学）；Ionian University（爱奥尼亚大学）；Aalto University（阿尔托大学）；Rutgers University（罗格斯大学）
Mobile networks are experiencing tremendous increase in data volume and user density. An efficient technique to alleviate this issue is to bring the data closer to the users by exploiting the caches of edge network nodes, such as fixed or mobile access points and even user devices. Meanwhile, the fusion of machine learning and wireless networks offers a viable way for network optimization as opposed to traditional optimization approaches which incur high complexity, or fail to provide optimal solutions. Among the various machine learning categories, reinforcement learning operates in an online…
In this paper, we propose a cache-aided non-orthogonal multiple access (NOMA) scheme for spectrally efficient downlink transmission. The proposed scheme not only reaps the benefits associated with NOMA and caching, but also exploits the data cached at the users for interference cancellation. As a consequence, caching can help to reduce the residual interference power, making multiple decoding orders at the users feasible. The resulting flexibility in decoding can be exploited for improved NOMA detection. We characterize the achievable rate region of cache-aided NOMA and derive the Pareto optim…
We consider the problem of multi-access cache-aided multi-user Private Information Retrieval (MuPIR). In this problem, several files are replicated across multiple servers. There are $K$ users and $C$ cache nodes. Each user can access $L$ cache nodes, and every cache node can be accessed by several users. Each user wants to retrieve one file from the servers, but the users do not want the servers to know their demands. Before the users decide their respective demands, servers will fill the cache nodes from the content of the files. Users will then request their desired files from the servers. …
A fundamental challenge of the large-scale Internet-of-Things lies in how to support massive machine-type communications (mMTC). This letter proposes a media modulation based mMTC solution for increasing the throughput, where a massive multi-input multi-output based base station (BS) is used for enhancing the detection performance. For such a mMTC scenario, the reliable active device detection and data decoding pose a serious challenge. By leveraging the sparsity of the uplink access signals of mMTC received at the BS, a compressive sensing based massive access solution is proposed for tacklin…
The paper treats uplink scenario where M user equipments (UEs) send to a Base Station (BS), possibly via a common Relay Station (RS) that is equipped with a buffer. This is a multiple-access relay channel (MARC) aided by a buffer. We devise a protocol in which the transmission mode is selected adaptively, using the buffer at the RS in order to maximize the average system throughput. We consider the general case in which the RS and the BS can have limits on the maximal number of transmitters that can be received over the multiple access channel. In each slot there are three type possible action…
Intelligent reflecting surface (IRS) as a promising technology rendering high throughput in future communication systems is compatible with various communication techniques such as non-orthogonal multiple-access (NOMA). In this paper, the downlink transmission of IRS-assisted NOMA communication is considered while undergoing imperfect channel state information (CSI). Consequently, a robust IRS-aided NOMA design is proposed by solving the sum-rate maximization problem to jointly find the optimal beamforming vectors for the access point and the passive reflection matrix for the IRS, using the pe…
This article focuses on the exploitation of reconfigurable intelligent surfaces (RISs) in multi-user networks employing orthogonal multiple access (OMA) or non-orthogonal multiple access (NOMA), with an emphasis on investigating the interplay between NOMA and RIS. Depending on whether the RIS reflection coefficients can be adjusted only once or multiple times during one transmission, we distinguish between static and dynamic RIS configurations. In particular, the capacity region of RIS aided single-antenna NOMA networks is characterized and compared with the OMA rate region from an information…
There is a paucity of random access protocols designed for alleviating collisions in visible light communication (VLC) systems, where carrier sensing is hard to be achieved due to the directionality of light. To resolve the problem of collisions, we adopt the successive interference cancellation (SIC) algorithm to enable the coordinator to simultaneously communicate with multiple devices, which is referred to as the multi-packet reception (MPR) capability. However, the MPR capability could be fully utilized only when random access algorithms are properly designed. Considering the characteristi…
A fog radio access network (F-RAN) is studied, in which $K_T$ edge nodes (ENs) connected to a cloud server via orthogonal fronthaul links, serve $K_R$ users through a wireless Gaussian interference channel. Both the ENs and the users have finite-capacity cache memories, which are filled before the user demands are revealed. While a centralized placement phase is used for the ENs, which model static base stations, a decentralized placement is leveraged for the mobile users. An achievable transmission scheme is presented, which employs a combination of interference alignment, zero-forcing and in…
The massiveness of devices in crowded Machine-to-Machine (M2M) communications brings new challenges to existing random-access (RA) schemes, such as heavy signaling overhead and severe access collisions. In order to reduce the signaling overhead, we propose a fixed-symbol aided RA scheme where active devices access the network in a grant-free method, i.e., data packets are directly transmitted in randomly chosen slots. To further address the access collision which impedes the activity detection, one fixed symbol is inserted into each transmitted data packet in the proposed scheme. An iterative …
Deep Reinforcement Learning (DRL) is gaining attention as a potential approach to design trajectories for autonomous unmanned aerial vehicles (UAV) used as flying access points in the context of cellular or Internet of Things (IoT) connectivity. DRL solutions offer the advantage of on-the-go learning hence relying on very little prior contextual information. A corresponding drawback however lies in the need for many learning episodes which severely restricts the applicability of such approach in real-world time- and energy-constrained missions. Here, we propose a model-aided deep Q-learning ap…
In this work, we explore the potential benefits of deploying unmanned aerial vehicles (UAVs) as aerial base stations (ABSs) with sub-6GHz band and small cells terrestrial base stations (TBSs) with millimeter wave (mmWave) band in a hybrid heterogeneous networks (HetNets). A flexible non-orthogonal multiple access (NOMA) based user association policy is proposed. By using the tools from stochastic geometry, new analytical expressions for association probability, coverage probability and spectrum efficiency are derived for characterizing the performance of UAV-aided HetNets under the realistic A…
Deep Reinforcement Learning-Based Precoding for Multi-RIS-Aided Multiuser Downlink Systems with Practical Phase Shift
Research Center for Information Technology Innovation (CITI), Academia Sinica（信息科技创新研究中心（CITI），学术院）；Institute of Communications Engineering, National Sun Yat-sen University（通讯工程研究所，国立中山大学）；Bradley Department of Electrical and Computer Engineering, Virginia Tech（电气与计算机工程系，弗吉尼亚理工大学）
In this paper, an energy-efficient cross-layer design framework is proposed for cooperative relaying networks, which takes into account the influence of spectrum utilization probability. Specifically, random arrival traffic is considered and an adaptive modulation and coding (AMC) scheme is adopted in the cooperative transmission system to improve the system performance. The average packet dropping rate of the relay-buffer is studied at first. With the packet dropping rate and stationary distribution of the system state, the closed-form expression of the delay is derived. Then the energy effic…
This letter studies a wireless system consisting of distributed ground terminals (GTs) communicating with an unmanned aerial vehicle (UAV) that serves as a mobile base station (BS). The UAV flies cyclically above the GTs at a fixed altitude, which results in a cyclical pattern of the strength of the UAV-GT channels. To exploit such periodic channel variations, we propose a new cyclical multiple access (CMA) scheme to schedule the communications between the UAV and GTs in a cyclical time-division manner based on the flying UAV's position. The time allocations to different GTs are optimized to m…
We investigate the fundamental multiple access (MA) scheme in an active intelligent reflecting surface (IRS) aided energy-constrained Internet-of-Things (IoT) system, where an active IRS is deployed to assist the uplink transmission from multiple IoT devices to an access point (AP). Our goal is to maximize the sum throughput by optimizing the IRS beamforming vectors across time and resource allocation. To this end, we first study two typical active IRS aided MA schemes, namely time division multiple access (TDMA) and non-orthogonal multiple access (NOMA), by analytically comparing their achiev…
The proliferation of connected vehicles along with the high demand for rich multimedia services constitute key challenges for the emerging 5G-enabled vehicular networks. These challenges include, but are not limited to, high spectral efficiency and low latency requirements. Recently, the integration of cache-enabled networks with non-orthogonal multiple access (NOMA) has been shown to reduce the content delivery time and traffic congestion in wireless networks. Ac-cordingly, in this article, we envisage cache-aided NOMA as a technology facilitator for 5G-enabled vehicular networks. In particul…
Given the proliferation of the massive machine type communication devices (MTCDs) in beyond 5G (B5G) wireless networks, energy harvesting (EH) aided next generation multiple access (NGMA) systems have drawn substantial attention in the context of energy-efficient data sensing and transmission. However, without adaptive time slot (TS) and power allocation schemes, NGMA systems relying on stochastic sampling instants might lead to tardy actions associated both with high age of information (AoI) as well as high power consumption. For mitigating the energy consumption, we exploit a pair of sleep-s…
In a cell-free massive multiple-input multiple-output (CF-mMIMO) network, multiple access points (APs) actively cooperate to serve users' equipment (UEs). We consider how the random access (RA) problem can be addressed by such a network under the occurrence of pilot collisions. To find a solution, we embrace the user-centric perspective, which basically dictates that only a preferred set of APs needs to serve a UE. Due to the success of the strongest-user collision resolution (SUCRe) protocol for cellular (Ce) mMIMO, we extend it by considering the new setting. Besides, we establish that the u…
