函数混合专家模型
Functional Mixtures-of-Experts
AI总结:
针对函数型异质性数据预测,提出函数混合专家(FME)模型及稀疏可解释变体iFME,采用EM-Lasso算法估计参数,在模拟和真实数据上验证了其捕捉非线性关系与聚类能力。
摘要:
我们考虑在观测包含函数(通常是时间序列)的情况下,对异质性数据进行统计预测分析。我们将混合专家(ME)模型——一种在向量观测数据预测中建模异质性的首选框架——扩展到这一函数数据分析情境中。首先,我们提出一个新的ME模型家族,称为函数ME(FME),其中预测变量是来自完整函数的潜在噪声观测。此外,预测变量和真实响应的数据生成过程由一个表示未知划分的隐藏离散变量控制。其次,通过对底层函数参数的导数施加稀疏性(通过类似Lasso的正则化),我们提供了FME模型的稀疏且可解释的函数表示,称为iFME。我们开发了专门的期望最大化算法,用于类似Lasso(EM-Lasso)正则化的最大似然参数估计策略,以拟合这些模型。所提出的模型和算法在模拟场景和两个真实数据集的应用中进行了研究,获得的结果证明了它们在准确捕获复杂非线性关系和聚类异质性回归数据方面的性能。
英文摘要:
We consider the statistical analysis of heterogeneous data for prediction in situations where the observations include functions, typically time series. We extend the modeling with Mixtures-of-Experts (ME), as a framework of choice in modeling heterogeneity in data for prediction with vectorial observations, to this functional data analysis context. We first present a new family of ME models, named functional ME (FME) in which the predictors are potentially noisy observations, from entire functions. Furthermore, the data generating process of the predictor and the real response, is governed by a hidden discrete variable representing an unknown partition. Second, by imposing sparsity on derivatives of the underlying functional parameters via Lasso-like regularizations, we provide sparse and interpretable functional representations of the FME models called iFME. We develop dedicated expectation--maximization algorithms for Lasso-like (EM-Lasso) regularized maximum-likelihood parameter estimation strategies to fit the models. The proposed models and algorithms are studied in simulated scenarios and in applications to two real data sets, and the obtained results demonstrate their performance in accurately capturing complex nonlinear relationships and in clustering the heterogeneous regression data.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。