arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2605.23151eess.SYcs.SYstat.ML
收藏

凸混合建模:一种基于算子的方法

Convex Hybrid Modeling: An Operator-Based Approach

North Carolina State University(北卡罗来纳州立大学)

Wentao Tang

AI总结:

本文提出一种基于算子的凸混合建模框架,通过凸学习问题系统性地融入可解释性约束,高效生成替代模型,并涵盖三种设置:参考模型正则化、可解释子空间限制以及非线性可解释流形限制。

摘要:

虽然机器学习可以精确建模过程系统,但用于决策的模型也应结构简单且物理可解释。例如,在过程控制中,(近乎)线性模型比非线性模型更受青睐,这促进了算子理论的应用,该理论通过非参数算子“通用”地表示非线性系统。另一方面,可解释性要求采用满足第一性原理的“非通用”参数化非线性模型族;这些约束往往使学习过程复杂化。本文通过制定凸学习问题来考虑混合建模,系统性地考虑可解释性,并高效地给出替代模型。讨论了三种设置——(i)围绕特定“参考模型”的正则化,(ii)对“可解释子空间”的限制,以及更一般地,(iii)对非线性参数化的“可解释流形”的限制。在更一般的设置中,通过引入一种算子理论技术,在“提升”参数(“规范特征”,可能是无限维的)中重新参数化模型,系统被视为基于核的可解释模型的混合。在数值研究中举例说明了静态和动态模型的应用。

英文摘要:

While machine learning can accurately model process systems, models for decision making should also be structurally simple and physically interpretable. In process control, for example, (nearly) linear models are favored than nonlinear ones, promoting the use of operator theory, which ``universally'' represents a nonlinear system by a nonparametric operator. On the other hand, interpretability requires by a ``non-universal'', parametric nonlinear model family satisfying first principles; these constraints tend to complicate the learning procedure. This paper considers hybrid modeling by formulating convex learning problems that account for interpretability systematically and give surrogate models efficiently. Three settings are discussed -- (i) regularization around a particular ``reference model'', (ii) restriction on an ``interpretable subspace'', and more generally, (iii) restriction on a ``interpretable manifold'' that is nonlinearly parameterized. In the more general setting, by introducing an operator-theoretic technique to re-parameterize models in the ``lifted'' parameters (``canonical features'', potentially infinite-dimensional), the system is regarded as a kernel-based mixture of interpretable models. Application to both static and dynamic models are exemplified in numerical studies.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑