arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2309.01764stat.MEecon.EMstat.ML
收藏

结构化稀疏模型的广义信息准则

Generalized Information Criteria for Structured Sparse Models

Eduardo F. Mendes, Gabriel J. P. Pinto

AI总结:

本文提出一种考虑稀疏模式的广义信息准则(GIC),用于高维正则化M估计的模型选择与正则化参数选择,并给出非渐近界及一致性条件,在广义线性回归和低秩矩阵回归中验证其有效性。

摘要:

正则化的M估计器因其在高维场景中恢复低维模型的能力而被广泛使用。近期一些研究致力于建立统一框架,用于确立预言界(oracle bounds)并推导支持恢复(support recovery)的条件。在此框架下,我们提出了一种新的广义信息准则(GIC),该准则考虑了人们希望恢复的稀疏模式。我们获得了GIC的非渐近模型选择界以及模型选择一致性的充分条件。此外,我们证明GIC还可用于在正则化M估计框架内选择正则化参数,这使得GIC在高维场景下的模型选择中具有实际应用价值。我们提供了广义线性回归和低秩矩阵回归背景下组LASSO(group LASSO)的示例。

英文摘要:

Regularized m-estimators are widely used due to their ability of recovering a low-dimensional model in high-dimensional scenarios. Some recent efforts on this subject focused on creating a unified framework for establishing oracle bounds, and deriving conditions for support recovery. Under this same framework, we propose a new Generalized Information Criteria (GIC) that takes into consideration the sparsity pattern one wishes to recover. We obtain non-asymptotic model selection bounds and sufficient conditions for model selection consistency of the GIC. Furthermore, we show that the GIC can also be used for selecting the regularization parameter within a regularized $m$-estimation framework, which allows practical use of the GIC for model selection in high-dimensional scenarios. We provide examples of group LASSO in the context of generalized linear regression and low rank matrix regression.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑