Remarks on the Rényi Entropy of a sum of IID random variables

Generalized LRS Estimator for Min-entropy Estimation

The min-entropy is a widely used metric to quantify the randomness of generated random numbers, which measures the difficulty of guessing the most likely output. It is difficult to accurately estimate the min-entropy of a non-independent and identically distributed (non-IID) source. Hence, NIST Special Publication (SP) 800-90B adopts ten different min-entropy estimators and then conservatively selects the minimum value among ten min-entropy estimates. Among these estimators, the longest repeated substring (LRS) estimator estimates the collision entropy instead of the min-entropy by counting th…

OAMP的容量最优性：超越IID感知矩阵和高斯信号

On Capacity Optimality of OAMP: Beyond IID Sensing Matrices and Gaussian Signaling

本文证明OAMP在大型酉不变系统中可达到replica方法预测的约束容量，提出变分传递函数与编码原理，优化LDPC码后性能超越Turbo-LMMSE，QPSK下BER接近容量。

Estimating a scalar log-concave random variable, using a silence set based probabilistic sampling

We study the probabilistic sampling of a random variable, in which the variable is sampled only if it falls outside a given set, which is called the silence set. This helps us to understand optimal event-based sampling for the special case of IID random processes, and also to understand the design of a sub-optimal scheme for other cases. We consider the design of this probabilistic sampling for a scalar, log-concave random variable, to minimize either the mean square estimation error, or the mean absolute estimation error. We show that the optimal silence interval: (i) is essentially unique, a…