arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1605.09232math.NAcs.LGcs.NAcs.NEmath.OCstat.ML
收藏

反问题中收敛速度与重建精度之间的权衡

Tradeoffs between Convergence Speed and Reconstruction Accuracy in Inverse Problems

School of Electrical Engineering, Tel Aviv University(特拉维夫大学电子工程学院);Electrical Engineering Department, Technion - IIT(技术学院-理工学院电子工程系);Computer Science Department, Technion - IIT(技术学院-理工学院计算机科学系);Electrical and Computer Engineering Department, Duke University(杜克大学电气与计算机工程系)

Raja Giryes, Yonina C. Eldar, Alex M. Bronstein, Guillermo Sapiro

AI总结:

研究探讨了在逆问题中,通过调整迭代算法以加快收敛速度同时保持重建精度的可行性,结合低维集的恢复技术,分析了粗略估计对收敛速度的影响。

摘要:

使用迭代算法求解逆问题在大数据中很流行。由于时间限制,迭代次数通常有限,可能影响可实现的精度。给定可接受的误差范围,一个重要问题是是否可以通过修改原始迭代方法,获得更快收敛到达到允许误差的极小值点,而不显著增加每次迭代的计算成本。基于最近为某些低维集信号恢复开发的恢复技术,我们表明使用该集的粗略估计可能以额外的重建误差为代价加快收敛。我们的理论与稀疏恢复、压缩感知和深度学习的最新进展相关。特别是,它可能为神经网络通过层表示迭代来近似l1最小化解的成功提供了可能的解释,如在学习迭代收缩阈值算法(LISTA)中实践的那样。

英文摘要:

Solving inverse problems with iterative algorithms is popular, especially for large data. Due to time constraints, the number of possible iterations is usually limited, potentially affecting the achievable accuracy. Given an error one is willing to tolerate, an important question is whether it is possible to modify the original iterations to obtain faster convergence to a minimizer achieving the allowed error without increasing the computational cost of each iteration considerably. Relying on recent recovery techniques developed for settings in which the desired signal belongs to some low-dimensional set, we show that using a coarse estimate of this set may lead to faster convergence at the cost of an additional reconstruction error related to the accuracy of the set approximation. Our theory ties to recent advances in sparse recovery, compressed sensing, and deep learning. Particularly, it may provide a possible explanation to the successful approximation of the l1-minimization solution by neural networks with layers representing iterations, as practiced in the learned iterative shrinkage-thresholding algorithm (LISTA).

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑