基于模型的深度学习:深度学习与优化的交叉点
Model-Based Deep Learning: On the Intersection of Deep Learning and Optimization
摘要:
决策制定算法用于多种不同的应用中。设计决策算法的传统方法采用原则性和简化的建模,基于此,可以通过易处理的优化来确定决策。最近,使用从数据中调整的高度参数化架构而不依赖于数学模型的深度学习方法变得越来越流行。基于模型的优化和以数据为中心的深度学习通常被认为是不同的学科。在这里,我们将它们描述为在特异性和参数化方面变化的连续谱的边缘,并为位于该谱中间地带的方法(称为基于模型的深度学习)提供教程式的演示。我们的演示伴随着超分辨率和随机控制中的运行示例,并展示了如何使用所提供的表征来表达它们,以及如何在每个详细方法中进行专业化。结合基于模型的优化和深度学习的收益使用各种应用中的实验结果进行了演示,从生物医学成像到数字通信。
英文摘要:
Decision making algorithms are used in a multitude of different applications. Conventional approaches for designing decision algorithms employ principled and simplified modelling, based on which one can determine decisions via tractable optimization. More recently, deep learning approaches that use highly parametric architectures tuned from data without relying on mathematical models, are becoming increasingly popular. Model-based optimization and data-centric deep learning are often considered to be distinct disciplines. Here, we characterize them as edges of a continuous spectrum varying in specificity and parameterization, and provide a tutorial-style presentation to the methodologies lying in the middle ground of this spectrum, referred to as model-based deep learning. We accompany our presentation with running examples in super-resolution and stochastic control, and show how they are expressed using the provided characterization and specialized in each of the detailed methodologies. The gains of combining model-based optimization and deep learning are demonstrated using experimental results in various applications, ranging from biomedical imaging to digital communications.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。