The combination of energy harvesting (EH), cognitive radio (CR), and non-orthogonal multiple access (NOMA) is a promising solution to improve energy efficiency and spectral efficiency of the upcoming beyond fifth generation network (B5G), especially for support the wireless sensor communications in Internet of things (IoT) system. However, how to realize intelligent frequency, time, and energy resource allocation to support better performances is an important problem to be solved. In this paper, we study joint spectrum, energy, and time resource management for the EH-CR-NOMA IoT systems. Our goal is to minimize the number of data packets losses for all secondary sensing users (SSU), while satisfying the constraints on the maximum charging battery capacity, maximum transmitting power, maximum buffer capacity, and minimum data rate of primary users (PU) and SSUs. Due to the non-convexity of this optimization problem and the stochastic nature of the wireless environment, we propose a distributed multidimensional resource management algorithm based on deep reinforcement learning (DRL). Considering the continuity of the resources to be managed, the deep deterministic policy gradient (DDPG) algorithm is adopted, based on which each agent (SSU) can manage its own multidimensional resources without collaboration. In addition, a simplified but practical action adjuster (AA) is introduced for improving the training efficiency and battery performance protection. The provided results show that the convergence speed of the proposed algorithm is about 4 times faster than that of DDPG, and the average number of packet losses (ANPL) is about 8 times lower than that of the greedy algorithm.
Active RIS-aided EH-NOMA Networks: A Deep Reinforcement Learning Approach
Anqing Normal University（安庆师范大学）；Dalian University of Technology（大连理工大学）；Chongqing University of Posts and Telecommunications（重庆邮电大学）；Xiamen University（厦门大学）；Zhejiang University（浙江大学）；Concordia University（康考迪亚大学）；Princeton University（普林斯顿大学）；University of Manchester（曼彻斯特大学）
The next generation Internet of Things (IoT) exhibits a unique feature that IoT devices have different energy profiles and quality of service (QoS) requirements. In this paper, two energy and spectrally efficient transmission strategies, namely wireless power transfer assisted non-orthogonal multiple access (WPT-NOMA) and backscatter communication assisted NOMA (BAC-NOMA), are proposed by utilizing this feature of IoT and employing spectrum and energy cooperation among the devices. Furthermore, for the proposed WPT-NOMA scheme, the application of hybrid successive interference cancelation (SIC…
In this paper, we propose an online power allocation scheme to maximize the time averaged sum rate for multiple downlink receivers with energy harvesting transmitter. The transmitter employs non-orthogonal multiple access (NOMA) and/or orthogonal multiple access (OMA) to transmit data to multiple users. Additionally, we consider the scenario where each individual user has a quality of service constraint on its required instantaneous rate. The decisions of total transmit power and power allocation for different users in a given time slot are obtained with the help of Lyapunov optimization techn…
Cooperative non-orthogonal multiple access (CNOMA) has recently been adapted with energy harvesting (EH) to increase energy efficiency and extend the lifetime of energy-constrained wireless networks. This paper proposes a hybrid EH protocol-assisted CNOMA, which is a combination of the two main existing EH protocols (power splitting (PS) and time switching (TS)). The end-to-end bit error rate (BER) expressions of users in the proposed scheme are obtained over Nakagami-$m$ fading channels. The proposed hybrid EH (HEH) protocol is compared with the benchmark schemes (i.e., existing EH protocols …
Motivated by the fact that the data rate of non-orthogonal multiple access (NOMA) can be greatly increased with the help of the distributed antenna system (DAS), we presents a framework in which the DAS contributes not only to the data rate but also the energy harvesting of simultaneous wireless information and power transfer (SWIPT) enabled NOMA. This study considers the sum-rate maximization problem and the max-min fairness problem for SWIPT-enabled NOMA in DAS and proposes two different schemes of power splitting and power allocation for SWIPT and NOMA, respectively, with imperfect channel …
This paper applies machine learning to optimize the transmission policy of cognitive radio inspired non-orthogonal multiple access (CR-NOMA) networks, where time-division multiple access (TDMA) is used to serve multiple primary users and an energy-constrained secondary user is admitted to the primary users' time slots via NOMA. During each time slot, the secondary user performs the two tasks: data transmission and energy harvesting based on the signals received from the primary users. The goal of the paper is to maximize the secondary user's long-term throughput, by optimizing its transmit pow…
Non-orthogonal multiple access (NOMA) has been widely recognized as a promising way to scale up the number of users, enhance the spectral efficiency, and improve the user fairness in wireless networks, by allowing more than one user to share one wireless resource. NOMA can be flexibly combined with many existing wireless technologies and emerging ones including multiple-input multiple-output (MIMO), massive MIMO, millimeter wave communications, cognitive and cooperative communications, visible light communications, physical layer security, energy harvesting, wireless caching, and so on. Combin…
In this work, we investigate reconfigurable intelligent surfaces (RIS)-assisted cooperative non-orthogonal multiple access (C-NOMA) consisting of two paired users, where the phases of RIS are configured to boost the cell-center device. The cell-center device is designated to act as a full-duplex (FD) relay to assist the cell-edge device. The cell-center device does not use its battery energy to cooperate but harvests energy using simultaneous wireless information power transfer (SWIPT). A more practical non-linear energy harvesting model is considered. Expressions for outage probability (OP) a…
In multicell massive multiple-input multiple-output (MIMO) non-orthogonal multiple access (NOMA) networks, base stations (BSs) with multiple antennas deliver their radio frequency energy in the downlink, and Internet-of-Things (IoT) devices use their harvested energy to support uplink data transmission. This paper investigates the energy efficiency (EE) problem for multicell massive MIMO NOMA networks with wireless power transfer (WPT). To maximize the EE of the network, we propose a novel joint power, time, antenna selection, and subcarrier resource allocation scheme, which can properly alloc…
This paper considers an intelligent reflecting surface(IRS)-aided wireless powered communication network (WPCN), where devices first harvest energy from a power station (PS) in the downlink (DL) and then transmit information using non-orthogonal multiple access (NOMA) to a data sink in the uplink (UL). However, most existing works on WPCNs adopted the simplified linear energy-harvesting model and also cannot guarantee strict user quality-of-service requirements. To address these issues, we aim to minimize the total transmit energy consumption at the PS by jointly optimizing the resource alloca…
Energy-efficient computation is an inevitable trend for mobile edge computing (MEC) networks. Resource allocation strategies for maximizing the computation efficiency are critically important. In this paper, computation efficiency maximization problems are formulated in wireless-powered MEC networks under both partial and binary computation offloading modes. A practical non-linear energy harvesting model is considered. Both time division multiple access (TDMA) and non-orthogonal multiple access (NOMA) are considered and evaluated for offloading. The energy harvesting time, the local computing …
Non-orthogonal multiple access (NOMA) and the cooperative relaying systems are two of the promising techniques to meet requirements of future wireless networks such as high spectral efficiency and wide coverage area. On the other hand, the energy efficiency has also high priority in the applications with limited energy such as sensor networks and/or internet of things (IoTs). To this end, in this paper, we propose wireless powered cooperative relaying system with NOMA thereby increasing spectral and energy efficiency. We consider three different energy harvesting (EH) protocols (i.e., power sh…
Given the proliferation of the massive machine type communication devices (MTCDs) in beyond 5G (B5G) wireless networks, energy harvesting (EH) aided next generation multiple access (NGMA) systems have drawn substantial attention in the context of energy-efficient data sensing and transmission. However, without adaptive time slot (TS) and power allocation schemes, NGMA systems relying on stochastic sampling instants might lead to tardy actions associated both with high age of information (AoI) as well as high power consumption. For mitigating the energy consumption, we exploit a pair of sleep-s…
A general form of codebook design for code-domain non-orthogonal multiple access (CD-NOMA) can be considered equivalent to an autoencoder (AE)-based constellation design for multi-user multidimensional modulation (MU-MDM). Due to a constrained design space for optimal constellation, e.g., fixed resource mapping and equal power allocation to all codebooks, however, existing AE architectures produce constellations with suboptimal bit-error-rate (BER) performance. Accordingly, we propose a new architecture for MU-MDM AE and underlying training methodology for joint optimization of resource mappin…
