Sharp variance-entropy comparison for nonnegative Gaussian quadratic forms
英文摘要:
In this article we study weighted sums of $n$ i.i.d. Gamma($α$) random variables with nonnegative weights. We show that for $n \geq 1/α$ the sum with equal coefficients maximizes differential entropy when variance is fixed. As a consequence, we prove that among nonnegative quadratic forms in $n$ independent standard Gaussian random variables, a diagonal form with equal coefficients maximizes differential entropy, under a fixed variance. This provides a sharp lower bound for the relative entropy between a nonnegative quadratic form and a Gaussian random variable. Bounds on capacities of transmission channels subject to $n$ independent additive gamma noises are also derived.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。