In this letter, we investigate the hybrid beamforming based on deep reinforcement learning (DRL) for millimeter Wave (mmWave) multi-user (MU) multiple-input-single-output (MISO) system. A multi-agent DRL method is proposed to solve the exploration efficiency problem in DRL. In the proposed method, prioritized replay buffer and more informative reward are applied to accelerate the convergence. Simulation results show that the proposed architecture achieves higher spectral efficiency and less time consumption than the benchmarks, thus is more suitable for practical applications.
Bilkent University（比尔肯特大学）；KTH Royal Institute of Technology（KTH皇家理工学院）
We introduce a novel deep reinforcement learning (DRL) approach to jointly optimize transmit beamforming and reconfigurable intelligent surface (RIS) phase shifts in a multiuser multiple input single output (MU-MISO) system to maximize the sum downlink rate under the phase-dependent reflection amplitude model. Our approach addresses the challenge of imperfect channel state information (CSI) and hardware impairments by considering a practical RIS amplitude model. We compare the performance of our approach against a vanilla DRL agent in two scenarios: perfect CSI and phase-dependent RIS amplitud…
Analog/digital hybrid beamforming architectures with large-scale antenna arrays have been widely considered in millimeter wave (mmWave) communication systems because they can address the tradeoff between performance and hardware efficiency compared with traditional fully-digital beamforming. Most of the prior work on hybrid beamforming focused on fullyconnected architecture or partially-connected scheme with fixedsubarrays, in which the analog beamformers are usually realized by infinite-resolution phase shifters (PSs). In this paper, we introduce a novel hybrid beamforming architecture with d…
When considering the future generation wireless networks, non-orthogonal multiple access (NOMA) represents a viable multiple access technique for improving the spectral efficiency. The basic performance of NOMA is often enhanced using downlink beamforming and power allocation techniques. Although downlink beamforming has been previously studied with different performance criteria, such as sum-rate and max-min rate, it has not been studied in the multiuser, multiple-input single-output (MISO) case, particularly with the energy efficiency criteria. In this paper, we investigate the design of an …
In this paper, large-scale intelligent reflecting sur-face (IRS)-assisted multiple-input single-output (MISO) system is considered in the presence of channel uncertainty. To maximize the average sum rate of the system by jointly optimizing the active beamforming at the BS and the passive phase shifts at the IRS, while satisfying the power constraints, a novel robust beamforming design is proposed by using the penalty dual decomposition (PDD) algorithm. By applying the upper bound maximization/minimization (BSUM) method, in each iteration of the algorithm, the optimal solution for each variable…
Perfect alignment in chosen beam sectors at both transmit- and receive-nodes is required for beamforming in mmWave bands. Current 802.11ad WiFi and emerging 5G cellular standards spend up to several milliseconds exploring different sector combinations to identify the beam pair with the highest SNR. In this paper, we propose a machine learning (ML) approach with two sequential convolutional neural networks (CNN) that uses out-of-band information, in the form of camera images, to (i) rapidly identify the locations of the transmitter and receiver nodes, and then (ii) return the optimal beam pair.…
Jeonbuk National University（国立全北大学）；Pukyong National University（釜庆国立大学）
This paper investigates a learning solution for robust beamforming optimization in downlink multi-user systems. A base station (BS) identifies efficient multi-antenna transmission strategies only with imperfect channel state information (CSI) and its stochastic features. To this end, we propose a robust training algorithm where a deep neural network (DNN), which only accepts estimates and statistical knowledge of the perfect CSI, is optimized to fit to real-world propagation environment. Consequently, the trained DNN can provide efficient robust beamforming solutions based only on imperfect ob…
The paper presents a joint beamforming algorithm using statistical channel state information (S-CSI) for reconfigurable intelligent surfaces (RIS) for multiuser MISO wireless communications. We used S-CSI, which is a long-term average of the cascaded channel as opposed to instantaneous CSI utilized in most existing works. Through this method, the overhead of channel estimation is dramatically reduced. We propose a proximal policy optimization (PPO) algorithm which is a well-known actor-critic based reinforcement learning (RL) algorithm to solve the optimization problem. To test the efficacy of…
Jeonbuk National University（全北国立大学）；Pukyong National University（釜庆国立大学）；Electronics and Telecommunications Research Institute (ETRI)（电子通信研究院）
This letter studies deep learning (DL) approaches to optimize beamforming vectors in downlink multi-user multi-antenna systems that can be universally applied to arbitrarily given transmit power limitation at a base station. We exploit the sum power budget as side information so that deep neural networks (DNNs) can effectively learn the impact of the power constraint in the beamforming optimization. Consequently, a single training process is sufficient for the proposed universal DL approach, whereas conventional methods need to train multiple DNNs for all possible power budget levels. Numerica…
MmWave multiple-input single-output (MISO) systems using a single-antenna receiver are regarded as promising solution for the near future, before the full-fledged 5G MIMO will be widespread. However, for MISO systems synchronization cannot be performed jointly with user localization unless two-way transmissions are used. In this paper we show that thanks to the use of a reconfigurable intelligent surface (RIS), joint localization and synchronization is possible with only downlink MISO transmissions. The direct maximum likelihood (ML) estimator for the position and clock offset is derived. To o…
In this paper, we propose two beamforming designs for a multiple-input single-output non-orthogonal multiple access system considering the energy efficiency (EE) fairness between users. In particular, two quantitative fairness-based designs are developed to maintain fairness between the users in terms of achieved EE: max-min energy efficiency (MMEE) and proportional fairness (PF) designs. While the MMEE-based design aims to maximize the minimum EE of the users in the system, the PF-based design aims to seek a good balance between the global energy efficiency of the system and the EE fairness b…
Hybrid analog and digital beamforming has emerged as a key enabling technology for millimeter wave (mmWave) massive multiple-input multiple-output (MIMO) communication systems since it can balance the trade-off between system performance and hardware efficiency. Owing to the strong ability of central control, cooperative networks show great potential to enhance the spectral efficiency of mmWave communications. In this paper, we consider cooperative mmWave MIMO systems and propose user association and hybrid beamforming design algorithms for three typical hybrid beamforming architectures. The c…
Reconfigurable intelligent surfaces (RISs) are considered to be a promising solution to overcome the blockage issue in the millimeter-wave (mmWave) band. Energy efficiency is an important performance metric in mmWave systems with a large number of antennas. However, due to the severe path loss in mmWave systems, resource allocation algorithms tend to allocate most of the resources for the benefit of the users with higher channel gains. In this paper, we propose a lexicographic-based approach to find the optimal power allocation, RIS phase shift matrix, and analog precoders that maximize both e…
Analog beamforming is the predominant approach for millimeter wave (mmWave) communication given its favorable characteristics for limited-resource devices. In this work, we aim at reducing the spectral efficiency gap between analog and digital beamforming methods. We propose a method for refined beam selection based on the estimated raw channel. The channel estimation, an underdetermined problem, is solved using compressed sensing (CS) methods leveraging angular domain sparsity of the channel. To reduce the complexity of CS methods, we propose dictionary learning iterative soft-thresholding al…
Beamforming Design Via GNN in mmWave Cell-Free Massive MIMO Using Sub-6 GHz CSI
Centre for Wireless Communications, University of Oulu（奥卢大学无线通信中心）；School of Electrical, Computer, and Energy Engineering, Arizona State University（亚利桑那州立大学电气、计算机与能源工程学院）
In this letter, we investigate the robust and secure beamforming (RSBF) in an intelligent reflecting surface (IRS) aided millimeter wave (mmWave) multiple input single output (MISO) system, where multiple single antenna eavesdroppers (Eves) are arbitrarily distributed nearby the legitimate receiver. Considering the channel state information (CSI) of Eves' channels is imperfectly known at the legitimate transmitter, the RSBF design problems to maximize the worst case of achievable secrecy rate (ASR) are formulated under the total transmission power and unit-modulus constraints. Since the proble…
This paper proposes a learning aided gradient descent (LAGD) algorithm to solve the weighted sum rate (WSR) maximization problem for multiple-input single-output (MISO) beamforming. The proposed LAGD algorithm directly optimizes the transmit precoder through implicit gradient descent based iterations, at each of which the optimization strategy is determined by a neural network, and thus, is dynamic and adaptive. At each instance of the problem, this network is initialized randomly, and updated throughout the iterative solution process. Therefore, the LAGD algorithm can be implemented at any si…
Hybrid analog and digital beamforming (HBF) has been recognized as an attractive technique offering a tradeoff between hardware implementation limitation and system performance for future broadband millimeter wave (mmWave) communications. In contrast to most current works focusing on the HBF design for orthogonal frequency division multiplexing based mmWave systems, this paper investigates the HBF design for single carrier (SC) systems due to the advantage of low peak-to-average power ratio in transmissions. By applying the alternating minimization method, we propose an efficient HBF scheme ba…
Beamforming is one of the key techniques in millimeter wave (mmWave) multi-input multi-output (MIMO) communications. Designing appropriate beamforming not only improves the quality and strength of the received signal, but also can help reduce the interference, consequently enhancing the data rate. In this paper, we propose a distributed multi-agent double deep Q-learning algorithm for beamforming in mmWave MIMO networks, where multiple base stations (BSs) can automatically and dynamically adjust their beams to serve multiple highly-mobile user equipments (UEs). In the analysis, largest receive…
Dynamic metasurface antennas (DMAs) provide a new paradigm to realize large-scale antenna arrays for future wireless systems. In this paper, we study the downlink millimeter wave (mmWave) DMA systems with limited number of radio frequency (RF) chains. By using a specific DMA structure, an equivalent mmWave channel model is first explicitly characterized. Based on that, we propose an effective joint microstrip selection and beamforming scheme to accommodate for the limited number of RF chains. A low-complexity digital beamforming solution with channel gain-based microstrip selection is develope…
Tsinghua University（清华大学）；Beijing National Research Center for Information Science and Technology（北京信息科学与技术国家研究中心）
Hybrid beamforming is widely recognized as an important technique for millimeter wave (mmWave) multiple input multiple output (MIMO) systems. Generalized spatial modulation (GSM) is further introduced to improve the spectrum efficiency. However, most of the existing works on beamforming assume the perfect channel state information (CSI), which is unrealistic in practical systems. In this paper, joint optimization of downlink pilot training, channel estimation, CSI feedback, and hybrid beamforming is considered in GSM aided frequency division duplexing (FDD) mmWave MIMO systems. With the help o…
Consider a multiuser downlink beamforming optimization problem for the non-orthogonal multiple access (NOMA) transmission in a multiple-input single-output (MISO) system. The total transmission power minimization problem is formulated subject to both per-antenna power constraints and quality-of-service (QoS) constraints under the NOMA principal. The problem is a non-convex quadratically constrained quadratic program, and the conventional semidefinite program (SDP) relaxation is not tight. In order to tackle the non-convex NOMA beamforming problem, we construct a second-order cone approximation…
Hybrid beamforming is considered a key enabler to realize millimeter wave (mmWave) multiple-input multiple-output (MIMO) communications due to its capability of considerably reducing the number of costly and power-hungry radio frequency chains in the transceiver. However, in mmWave MIMO orthogonal frequency-division multiplexing (MIMO-OFDM) systems, hybrid beamforming design is challenging because the analog precoder and combiner are required to be shared across the whole employed bandwidth. In this paper, we propose closed-form solutions to the problem of designing the analog precoder/combine…
Perfect channel state information (CSI) is challenging to obtain due to the limited signal processing capability at the intelligent reflection surface (IRS). In this paper, we study the worst-case robust beamforming design for an IRS-aided multiuser multiple-input single-output (MU-MISO) system under the assumption of imperfect CSI. We aim for minimizing the transmit power while ensuring that the achievable rate of each user meets the quality of service (QoS) requirement for all possible channel error realizations. With unit-modulus and rate constraints, this problem is non-convex. The imperfe…
Reconfigurable intelligent surface (RIS) is an attractive technology to improve the transmission rate of millimetre-wave (mmWave) communication systems. The previous {research} on RIS technology mainly focused on improving the transmission rate and security rate of the mmWave communication systems. Since the emergence of RIS technology creates the conditions for generating an intelligent radio environment, it also has potential advantages on improving the localization accuracy of the mmWave communication systems. Deployed on walls and objects, RISs are capable of significantly improving commun…
In this paper, an reconfigurable intelligent surface (RIS)-aided millimeter wave (mmWave) non-orthogonal multiple access (NOMA) system is considered. In particular, we consider an RIS-aided mmWave-NOMA downlink system with a hybrid beamforming structure. To maximize the achievable sum-rate under a minimum rate constraint for the users and a minimum transmit power constraint, a joint RIS phase shifts, hybrid beamforming, and power allocation problem is formulated. To solve this non-convex optimization problem, we develop an alternating optimization algorithm. Specifically, first, the non-convex…
The wide bandwidths offered at millimeter-wave (mmWave) frequencies have made them an attractive choice for future wireless communication systems. Recent works have presented beamforming strategies for enabling in-band full-duplex (FD) capability at mmWave even under the constraints of hybrid beamforming, extending the exciting possibilities of next-generation wireless. Existing mmWave FD designs, however, do not consider frequency-selective mmWave channels. Wideband communication at mmWave suggests that frequency-selectivity will likely be of concern since communication channels will be on th…
This paper investigates the achievable rate region of the multiple-input single-output (MISO) interference channel aided by intelligent reflecting surfaces (IRSs). We exploit the the additional design degree of freedom provided by the coordinated IRSs to enhance the desired signal and suppress interference so as to enlarge the achievable rate region of the interference channel. To this end, we jointly optimize the active transmit beamforming at the transmitters and passive reflective beamforming at the IRSs, subject to the constant modulus constraints of reflective beamforming vectors. To addr…
Full-duplex (FD) systems gained enormous attention because of the potential to double the spectral efficiency. In the context of 5G technology, FD systems operating at millimeter-wave (mmWave) frequencies become one of the most promising solutions to further increase the spectral efficiency and reduce the latency. However, such systems are vulnerable to the self-interference (SI) that significantly degrades the performance. To overcome this shortcoming, analog-only beamforming techniques have been developed to mitigate the SI. Because of the huge power consumption, systems operating at mmWave …
As a cost-effective alternative, hybrid analog and digital beamforming architecture is a promising scheme for millimeter wave (mmWave) system. This paper considers two hybrid beamforming architectures, i.e. the partially-connected and fully-connected structures, for mmWave dual-function radar communication (DFRC) system, where the transmitter communicates with the downlink users and detects radar targets simultaneously. The optimization problems are formulated by minimizing a weighted summation of radar and communication performance, subject to constant modulus and power constraints. To tackle…
Mobile edge computing (MEC) and millimeter wave (mmWave) communications are capable of significantly reducing the network's delay and enhancing its capacity. In this paper we investigate a mmWave and device-to-device (D2D) assisted MEC system, in which user A carries out some computational tasks and shares the results with user B with the aid of a base station (BS). We propose a novel two-timescale joint hybrid beamforming and task allocation algorithm to reduce the system latency whilst cut down the required signaling overhead. Specifically, the high-dimensional analog beamforming matrices ar…
Unmanned aerial vehicles (UAVs) have found widespread commercial, civilian, and military applications. Wireless communication has always been one of the core technologies for UAV. However, the communication capacity is becoming a bottleneck for UAV to support more challenging application scenarios. The heavily-occupied sub-6 GHz frequency band is not sufficient to meet the ultra high-data-traffic requirements. The utilization of the millimeter-wave (mmWave) frequency bands is a promising direction for UAV communications, where large antenna arrays can be packed in a small area on the UAV to pe…
In this paper, we propose a beamforming design for dual-functional radar-communication (DFRC) systems at the millimeter wave (mmWave) band, where hybrid beamforming and sub-arrayed MIMO radar techniques are jointly exploited. We assume that a base station (BS) is serving a user equipment (UE) located in a Non-Line-of-Sight (NLoS) channel, which in the meantime actively detects multiple targets located in a Line-of-Sight (LoS) channel. Given the optimal communication beamformer and the desired radar beampattern, we propose to design the analog and digital beamformers under non-convex constant-m…
Downlink beamforming is an essential technology for wireless cellular networks; however, the design of beamforming vectors that maximize the weighted sum rate (WSR) is an NP-hard problem and iterative algorithms are typically applied to solve it. The weighted minimum mean square error (WMMSE) algorithm is the most widely used one, which iteratively minimizes the WSR and converges to a local optimal. Motivated by the recent developments in meta-learning techniques to solve non-convex optimization problems, we propose a meta-learning based iterative algorithm for WSR maximization in a MISO downl…
This paper investigates an intelligent reflecting surface (IRS)-aided multi-cell multiple-input single-output (MISO) system consisting of several multi-antenna base stations (BSs) each communicating with a single-antenna user, in which an IRS is dedicatedly deployed for assisting the wireless transmission and suppressing the inter-cell interference. Under this setup, we jointly optimize the coordinated transmit beamforming at the BSs and the reflective beamforming at the IRS, for the purpose of maximizing the minimum weighted received signal-to-interference-plus-noise ratio (SINR) at users, su…
In this paper, we investigate an intelligent reflect surface (IRS) assisted multi-user millimeter wave (mmWave) downlink communication system, exploiting IRS to alleviate the blockage effect and enhance the performance of the mmWave system. Considering the impact of IRS on user association, we formulate a sum rate maximization problem by jointly optimizing the passive beamforming at IRS and user association, which is an intractable non-convex problem. Then an alternating optimization algorithm is proposed to solve the problem efficiently. In the proposed algorithm, passive beamforming at IRS i…
Performance Analysis of Digital Beamforming mmWave MIMO with Low-Resolution DACs/ADCs
TU Wien（维也纳工业大学）；Christian Doppler Laboratory for Digital Twin assisted AI for sustainable Radio Access Networks（可持续无线接入网数字孪生辅助AI克劳迪普勒实验室）；Lund University（隆德大学）
In this paper, we address the problem of three dimensional beamforming in millimeter wave (mmWave) wireless networks. In particular, we study the impact of base station (BS) antenna tilt angle optimization on the energy efficiency (EE) of mmWave networks under two different scenarios: a homogeneous network consisting of multiple macro base stations (MBSs), and a heterogeneous network where several femto base stations are added within the coverage areas of the MBSs. First, by adopting a stochastic geometry approach, we analyze the coverage probability of both scenarios that incorporate 3DBF. Th…
Intelligent reflecting surface (IRS) has been considered as a promising technology to alleviate the blockage effect and enhance coverage in millimeter wave (mmWave) communication. To explore the impact of IRS on the performance of mmWave communication, we investigate a multi-IRS assisted mmWave communication network and formulate a sum rate maximization problem by jointly optimizing the active and passive beamforming and the set of IRSs for assistance. The optimization problem is intractable due to the lack of convexity of the objective function and the binary nature of the IRS selection varia…
Intelligent reflecting surface (IRS) has the potential to significantly enhance the network performance by reconfiguring the wireless propagation environments. It is however difficult to obtain the accurate downlink channel state information (CSI) for efficient beamforming design in IRS-aided wireless networks. In this article, we consider an IRS-aided downlink multiple-input single-output (MISO) network, where the base station (BS) is not required to know the underlying channel distribution. We formulate an outage probability minimization problem by jointly optimizing the beamforming vector a…
This paper investigates an intelligent reflecting surface (IRS)-aided multi-cell multiple-input single-output (MISO) system with several multi-antenna base stations (BSs) each communicating with a single-antenna user, in which an IRS is dedicatedly deployed for assisting the wireless transmission and suppressing the inter-cell interference. Under this setup, we jointly optimize the coordinated transmit beamforming at the BSs and the reflective beamforming at the IRS, for the purpose of maximizing the minimum weighted signal-to-interference-plus-noise ratio (SINR) at the users, subject to the i…
Owing to the unique advantages of low cost and controllability, reconfigurable intelligent surface (RIS) is a promising candidate to address the blockage issue in millimeter wave (mmWave) communication systems, consequently has captured widespread attention in recent years. However, the joint active beamforming and passive beamforming design is an arduous task due to the high computational complexity and the dynamic changes of wireless environment. In this paper, we consider a RIS-assisted multi-user multiple-input single-output (MU-MISO) mmWave system and aim to develop a deep reinforcement l…
This paper studies a novel approach for successive interference cancellation (SIC) ordering and beamforming in a multiple antennas non-orthogonal multiple access (NOMA) network with multi-carrier multi-user setup. To this end, we formulate a joint beamforming design, subcarrier allocation, user association, and SIC ordering algorithm to maximize the worst-case energy efficiency (EE). The formulated problem is a non-convex mixed integer non-linear programming (MINLP) which is generally difficult to solve. To handle it, we first adopt the linearizion technique as well as relaxing the integer var…
This paper studies an intelligent reflecting surface (IRS)-assisted multiuser multiple-input single-output (MISO) simultaneous wireless information and power transfer (SWIPT) system. In this system, a multi-antenna access point (AP) uses transmit beamforming to send both information and energy signals to a set of receivers each for information decoding (ID) or energy harvesting (EH), and a dedicatedly deployed IRS properly controls its reflecting phase shifts to form passive reflection beams for facilitating both ID and EH at receivers. Under this setup, we jointly optimize the (active) inform…
Reconfigurable intelligent surface (RIS) assisted millimeter-wave (mmWave) communication systems relying on hybrid beamforming structures are capable of achieving high spectral efficiency at a low hardware complexity and low power consumption. In this paper, we propose an RIS-assisted mmWave point-to-point system relying on dynamically configured sub-array connected hybrid beamforming structures. More explicitly, an energy-efficient analog beamformer relying on twin-resolution phase shifters is proposed. Then, we conceive a successive interference cancelation (SIC) based method for jointly des…
Beamforming technology is widely used in millimeter wave systems to combat path losses, and beamformers are usually selected from a predefined codebook. Unfortunately, the traditional codebook design neglects the beam squint effect, and this will cause severe performance degradation when the bandwidth is large. In this letter, we consider that a codebook with fixed size is adopted in the wideband beamforming system. First, we analyze how beam squint affects system performance when all beams have the same width. The expression of average spectrum efficiency is derived based on the ideal beam pa…
Millimeter wave (mmWave) communication represents one of the main innovations of the next generation of wireless technologies, allowing users to reach unprecedented data rates. To overcome the high path loss at mmWave frequencies, these systems make use of directional antennas able to focus the transmit power into narrow beams using BeamForming (BF) techniques, thus making the communication directional. This new paradigm opens up a set of challenges for the design of efficient wireless systems, in which antenna and BF components play an important role also at the higher layer of the protocol s…
Considering intelligent reflecting surface (IRS), we study a multi-cluster multiple-input-single-output (MISO) non-orthogonal multiple access (NOMA) downlink communication network. In the network, an IRS assists the communication from the base station (BS) to all users by passive beamforming. Our goal is to minimize the total transmit power by jointly optimizing the transmit beamforming vectors at the BS and the reflection coefficient vector at the IRS. Because of the restrictions on the IRS reflection amplitudes and phase shifts, the formulated quadratically constrained quadratic problem is h…
This paper presents a comparative study on millimeter wave (mmWave) location-based analog beamforming (BF) techniques based on channel estimation. Localization and compressive sensing (CS) effectively reduces mmWave BF complexity and enhance the performance of mmWave system comparable to the conventional mmWave analog BF techniques. BF techniques based on channel state information (CSI) has high complexity in constructing mmWave channel sensing matrix using CS. Location services based techniques highly reduce this complexity by defining the area within which the user equipment (UE) mostly prob…
