arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2202.03391cs.LGeess.SP
收藏

用于信号恢复的离散结构化测量算子的基于梯度学习

Gradient-Based Learning of Discrete Structured Measurement Operators for Signal Recovery

EPFL(洛桑联邦理工学院);Helmholtz-Zentrum Berlin(柏林亥姆霍兹中心);Technische Universität Berlin(柏林工业大学)

Jonathan Sauder, Martin Genzel, Peter Jung

AI总结:

提出GLODISMO方法,结合展开优化与Gumbel重参数化,解决离散结构化测量算子的基于梯度学习问题,在信号恢复应用中表现优于传统设计。

摘要:

无数信号处理应用包括从少量间接线性测量中重建信号。有效测量算子的设计通常受限于底层硬件和物理条件,这构成了一个具有挑战性且往往是离散的优化任务。尽管通过展开迭代恢复算法进行基于梯度学习的潜力已被证实,但当可允许测量算子的集合是结构化且离散时,如何利用该技术仍不明确。我们通过将展开优化与Gumbel重参数化相结合来解决这一问题,该组合能够计算分类随机变量的低方差梯度估计。我们的方法被形式化为GLODISMO(离散结构化测量算子的基于梯度学习)。由于与自动微分兼容,这种新方法易于实现、计算效率高且可扩展。我们在几个原型信号恢复应用中实证证明了GLODISMO的性能和灵活性,验证了学习到的测量矩阵优于基于随机化的传统设计以及离散优化基线。

英文摘要:

Countless signal processing applications include the reconstruction of signals from few indirect linear measurements. The design of effective measurement operators is typically constrained by the underlying hardware and physics, posing a challenging and often even discrete optimization task. While the potential of gradient-based learning via the unrolling of iterative recovery algorithms has been demonstrated, it has remained unclear how to leverage this technique when the set of admissible measurement operators is structured and discrete. We tackle this problem by combining unrolled optimization with Gumbel reparametrizations, which enable the computation of low-variance gradient estimates of categorical random variables. Our approach is formalized by GLODISMO (Gradient-based Learning of DIscrete Structured Measurement Operators). This novel method is easy-to-implement, computationally efficient, and extendable due to its compatibility with automatic differentiation. We empirically demonstrate the performance and flexibility of GLODISMO in several prototypical signal recovery applications, verifying that the learned measurement matrices outperform conventional designs based on randomization as well as discrete optimization baselines.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑