In this paper, we design and analyze distributed vector quantization (VQ) for compressed measurements of correlated sparse sources over noisy channels. Inspired by the framework of compressed sensing (CS) for acquiring compressed measurements of the sparse sources, we develop optimized quantization schemes that enable distributed encoding and transmission of CS measurements over noisy channels followed by joint decoding at a decoder. The optimality is addressed with respect to minimizing the sum of mean-square error (MSE) distortions between the sparse sources and their reconstruction vectors at the decoder. We propose a VQ encoder-decoder design via an iterative algorithm, and derive a lower-bound on the end-to-end MSE of the studied distributed system. Through several simulation studies, we evaluate the performance of the proposed distributed scheme.
This paper proposes a codebook for jointly quantizing channel direction information (CDI) of spatially correlated three-dimensional (3D) multi-input-multi-output (MIMO) channels. To reduce the dimension for quantizing the CDI of large antenna arrays, we introduce a special structure to the codewords by using Tucker decomposition to exploit the unique features of 3D MIMO channels. Specifically, the codeword consists of four parts each with low dimension individually targeting at a different type of information: statistical CDIs in horizontal direction and in vertical direction, statistical powe…
This paper analyzes the performance of multicell massive multiple-input and multiple-output (MIMO) systems with variable-resolution analog-to-digital converters (ADCs). In such an architecture, each ADC uses arbitrary quantization resolution to save power and hardware cost. Along this direction, we first introduce a quantization-aware channel estimator based on additive quantization noise model (AQNM) and linear minimum mean-squared error (LMMSE) estimate theory. Afterwards, by leveraging on the estimated channel state information (CSI), we derive the asymptotic expressions of achievable uplin…
This paper investigates the problem of secret key generation over a wiretap channel when the terminals observe correlated sources. These sources are independent of the main channel and the users overhear them before the transmission takes place. A novel achievable scheme is proposed, and its optimality is shown under certain less-noisy conditions. This result improves upon the existing literature where the more stringent condition of degradedness is required. Furthermore, numerical evaluation of the proposed scheme and previously reported results for a binary model are presented; a comparison …
We consider the multi-user lossy source-coding problem for continuous alphabet sources. In a previous work, Ziv proposed a single-user universal coding scheme which uses uniform quantization with dither, followed by a lossless source encoder (entropy coder). In this paper, we generalize Ziv's scheme to the multi-user setting. For this generalized universal scheme, upper bounds are derived on the redundancies, defined as the differences between the actual rates and the closest corresponding rates on the boundary of the rate region. It is shown that this scheme can achieve redundancies of no mor…
In this paper, we propose trellis coded quantization (TCQ) based limited feedback techniques for massive multiple-input single-output (MISO) frequency division duplexing (FDD) systems in temporally and spatially correlated channels. We exploit the correlation present in the channel to effectively quantize channel direction information (CDI). For multiuser (MU) systems with matched-filter (MF) precoding, we show that the number of feedback bits required by the random vector quantization (RVQ) codebook to match even a small fraction of the perfect CDI signal-to-interference-plus-noise ratio (SIN…
In frequency division duplex (FDD) multiple-input multiple-output (MIMO) wireless communications, limited channel state information (CSI) feedback is a central tool to support advanced single- and multi-user MIMO beamforming/precoding. To achieve a given CSI quality, the CSI quantization codebook size has to grow exponentially with the number of antennas, leading to quantization complexity, as well as, feedback overhead issues for larger MIMO systems. We have recently proposed a multi-stage recursive Grassmannian quantizer that enables a significant complexity reduction of CSI quantization. In…
We study the problem of distributed mean estimation and optimization under communication constraints. We propose a correlated quantization protocol whose leading term in the error guarantee depends on the mean deviation of data points rather than only their absolute range. The design doesn't need any prior knowledge on the concentration property of the dataset, which is required to get such dependence in previous works. We show that applying the proposed protocol as sub-routine in distributed optimization algorithms leads to better convergence rates. We also prove the optimality of our protoco…
The existing investigations on artificial noise (AN) security systems assumed that only null spaces is used to send AN signals, and all eigen-subchannels should be used to transmit messages. Our previous work proposed an AN scheme that allocates some of eigen-subchannels to transmit AN signals for improving secrecy rates. Nevertheless, our previous work considered only uncorrelated MIMO Rayleigh fading channels. In fact, the correlations among antennas exist in realistic scattering channel environments. In this paper, we extend our previous AN scheme to spatially correlated Rayleigh fading cha…
Abstract-One-bit compressive sensing (CS) is known to be particularly suited for resource-constrained wireless sensor networks (WSNs). In this paper, we consider 1-bit CS over noisy WSNs subject to channel-induced bit flipping errors, and propose an amplitude-aided signal reconstruction scheme, by which (i) the representation points of local binary quantizers are designed to minimize the loss of data fidelity caused by local sensing noise, quantization, and bit sign flipping, and (ii) the fusion center adopts the conventional minimization method for sparse signal recovery using the decoded and…
We investigate the sign-linear embeddings of 1-bit compressed sensing given by Gaussian measurements. One can give short arguments concerning a Restricted Isometry Property of such maps using Vapnik-Chervonenkis dimension of sparse hemispheres. This approach has a natural extension to the presence of additive white noise prior to quantization. Noisy one-bit mappings are shown to satisfy an RIP when the metric on the sphere is given by the noise.
Low-resolution digital-to-analog converter (DAC) has shown great potential in facilitating cost- and power-efficient implementation of massive multiple-input multiple-output (MIMO) systems. We investigate the performance of a massive MIMO downlink network with low-resolution DACs using regularized zero-forcing (RZF) precoding. It serves multiple receivers equipped with finite-resolution analog-to-digital converters (ADCs). By taking the quantization errors at both the transmitter and receivers into account under spatially correlated channels, the regularization parameter for RZF is optimized w…
We develop a direction of arrival (DoA) and channel estimation algorithm for the one-bit quantized millimeter-wave (mmWave) massive multiple-input multiple-output (MIMO) system. By formulating the estimation problem as a noisy one-bit compressed sensing problem, we propose a computationally efficient gridless solution based on the expectation-maximization generalized approximate message passing (EMGAMP) approach. The proposed algorithm does not need the prior knowledge about the number of DoAs and outperforms the existing methods in distinguishing extremely close DoAs for the case of one-bit q…
The effects of quantization and coding on the estimation quality of Gauss-Markov processes are considered, with a special attention to the Ornstein-Uhlenbeck process. Samples are acquired from the process, quantized, and then encoded for transmission using either infinite incremental redundancy (IIR) or fixed redundancy (FR) coding schemes. A fixed processing time is consumed at the receiver for decoding and sending feedback to the transmitter. Decoded messages are used to construct a minimum mean square error (MMSE) estimate of the process as a function of time. This is shown to be an increas…
A distributed binary hypothesis testing problem, in which multiple observers transmit their observations to a detector over noisy channels, is studied. Given its own side information, the goal of the detector is to decide between two hypotheses for the joint distribution of the data. Single-letter upper and lower bounds on the optimal type 2 error exponent (T2-EE), when the type 1 error probability vanishes with the block-length are obtained. These bounds coincide and characterize the optimal T2-EE when only a single helper is involved. Our result shows that the optimal T2-EE depends on the ma…
We address the issue of applying quantized compressed sensing (CS) on low-energy telemonitoring. So far, few works studied this problem in applications where signals were only approximately sparse. We propose a two-stage data compressor based on quantized CS, where signals are compressed by compressed sensing and then the compressed measurements are quantized with only 2 bits per measurement. This compressor can greatly reduce the transmission bit-budget. To recover signals from underdetermined, quantized measurements, we develop a Bayesian De-quantization algorithm. It can exploit both the mo…
We address the problem of quantifying the cryptographic content of probability distributions, in relation to an application to secure multi-party sampling against a passive t-adversary. We generalize a recently introduced notion of assisted common information of a pair of correlated sources to that of K sources and define a family of monotone rate regions indexed by K. This allows for a simple characterization of all t-private distributions that can be statistically securely sampled without any auxiliary setup of pre-shared noisy correlations. We also give a new monotone called the residual to…
We present optimal sample complexity estimates for one-bit compressed sensing problems in a realistic scenario: the procedure uses a structured matrix (a randomly sub-sampled circulant matrix) and is robust to analog pre-quantization noise as well as to adversarial bit corruptions in the quantization process. Our results imply that quantization is not a statistically expensive procedure in the presence of nontrivial analog noise: recovery requires the same sample size one would have needed had the measurement matrix been Gaussian and the noisy analog measurements been given as data.
Information theoretic secret key agreement is impossible without making initial assumptions. One type of initial assumption is correlated random variables that are generated by using a noisy channel that connects the terminals. Terminals use the correlated random variables and communication over a reliable public channel to arrive at a shared secret key. Previous channel models assume that each terminal either controls one input to the channel, or receives one output variable of the channel. In this paper, we propose a new channel model of transceivers where each terminal simultaneously contro…
In this paper, we consider the problem of recovering a sparse signal from noisy linear measurements using the so called LASSO formulation. We assume a correlated Gaussian design matrix with additive Gaussian noise. We precisely analyze the high dimensional asymptotic performance of the LASSO under correlated design matrices using the Convex Gaussian Min-max Theorem (CGMT). We define appropriate performance measures such as the mean-square error (MSE), probability of support recovery, element error rate (EER) and cosine similarity. Numerical simulations are presented to validate the derived the…
We consider the strong secret key (SK) agreement problem for the satellite communication setting, where a satellite chooses a common binary phase shift keying modulated input for three statistically independent additive white Gaussian noise measurement channels whose outputs are observed by two legitimate transceivers (Alice and Bob) and an eavesdropper (Eve), respectively. Legitimate transceivers have access to an authenticated, noiseless, two-way, and public communication link, so they can exchange multiple rounds of public messages to agree on a SK hidden from Eve. Without loss of essential…
