arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2307.05352eess.SPcs.ITmath.ITstat.ML
收藏

利用变分自编码器进行参数化 MMSE 估计

Leveraging Variational Autoencoders for Parameterized MMSE Estimation

Michael Baur, Benedikt Fesl, Wolfgang Utschick

AI总结:

本文提出基于变分自编码器的框架参数化条件线性MMSE估计器,通过将数据分布建模为条件高斯分布生成先验以近似MMSE估计器,设计了三种变体,严格分析了误差界限与偏差-方差权衡,并在信道估计等数值模拟中展现出优于SOTA的性能。

摘要:

在本文中,我们提出使用基于变分自编码器的框架来参数化条件线性最小均方误差(MMSE)估计器。变分自编码器将潜在的未知数据分布建模为条件高斯分布,从而在给定含噪观测的情况下,得出被估计量的条件一阶矩和二阶矩。结果表明,通过将变分自编码器作为估计问题的生成先验,所推导的估计器能够近似最小均方误差估计器。我们提出了三种估计器变体,它们在训练和估计阶段对真实数据的访问权限上有所不同。仅基于含噪观测训练的所提估计器变体尤其值得关注,因为它在训练或估计过程中均不需要访问真实数据。我们通过界定所提估计器与最小均方误差估计器之间的差异进行了严格分析,将训练目标与最终的估计性能联系起来。此外,所得界限表明,所提估计器涉及估计文献中众所周知的偏差-方差权衡。作为示例应用,我们描绘了信道估计,允许结构化的协方差矩阵参数化和低复杂度实现。然而,所提框架不限于信道估计,而是可以应用于广泛的估计问题类别。大量的数值模拟首先验证了所提基于变分自编码器的估计器的理论分析,然后证明了与相关的经典和基于机器学习的最先进估计器相比,其具有出色的估计性能。

英文摘要:

In this manuscript, we propose to use a variational autoencoder-based framework for parameterizing a conditional linear minimum mean squared error estimator. The variational autoencoder models the underlying unknown data distribution as conditionally Gaussian, yielding the conditional first and second moments of the estimand, given a noisy observation. The derived estimator is shown to approximate the minimum mean squared error estimator by utilizing the variational autoencoder as a generative prior for the estimation problem. We propose three estimator variants that differ in their access to ground-truth data during the training and estimation phases. The proposed estimator variant trained solely on noisy observations is particularly noteworthy as it does not require access to ground-truth data during training or estimation. We conduct a rigorous analysis by bounding the difference between the proposed and the minimum mean squared error estimator, connecting the training objective and the resulting estimation performance. Furthermore, the resulting bound reveals that the proposed estimator entails a bias-variance tradeoff, which is well-known in the estimation literature. As an example application, we portray channel estimation, allowing for a structured covariance matrix parameterization and low-complexity implementation. Nevertheless, the proposed framework is not limited to channel estimation but can be applied to a broad class of estimation problems. Extensive numerical simulations first validate the theoretical analysis of the proposed variational autoencoder-based estimators and then demonstrate excellent estimation performance compared to related classical and machine learning-based state-of-the-art estimators.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑