arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2301.03015stat.MEmath.STstat.TH
收藏

一种处理共线性回归的建模框架

A Modelling Framework for Regression with Collinearity

Takeaki Kariya, Hiroshi Kurata, Takaki Hayashi

AI总结:

本文提出一种处理共线性回归的实证有效建模框架EEM-M,通过两个模型选择过程分别控制共线性并评估整体性能,并设计了两种算法实现该框架。

摘要:

本研究解决了带有共线性的OLS回归模型$\boldsymbol{y}=\boldsymbol{Xβ}+\boldsymbol{u}$中标准理论与实证建模实践之间一个根本但被忽视的差距。事实上,虽然实践中估计的模型期望在其“个体OLS估计”中具有稳定性和有效性,但$\boldsymbol{y}$本身没有能力识别和控制$\boldsymbol{X}$中的共线性,因此除非从抽样理论的角度控制$\boldsymbol{X}$,否则包括模型选择过程(MSP)在内的任何理论都无法填补这一差距。本文首先引入“实证有效建模”(EEM)的新概念,提出EEM方法(EEM-M)作为在给定数据$(\boldsymbol{y^o,X})$下两个MSP的集成过程。第一个MSP仅使用$\boldsymbol{X}$,称为XMSP,预选一类模型$\scr{D}$,这些模型具有单独的无效性控制和共线性控制的OLS估计,其中相应的两个控制变量从每个估计的预测标准误差中选择。接下来,为每个模型定义无效性-共线性风险指数,在不使用$\boldsymbol{y^o}$的情况下引入模型集合上的偏序进行比较,讨论了模型的优越性和可接受性。第二个MSP是常用的MSP,使用$(\boldsymbol{y^o,X})$,通过AIC、BIC等评估整体模型性能,从$\scr{D}$中选择最优模型。第三,为实现XMSP,提出了两种算法。

英文摘要:

This study addresses a fundamental, yet overlooked, gap between standard theory and empirical modelling practices in the OLS regression model $\boldsymbol{y}=\boldsymbol{Xβ}+\boldsymbol{u}$ with collinearity. In fact, while an estimated model in practice is desired to have stability and efficiency in its "individual OLS estimates", $\boldsymbol{y}$ itself has no capacity to identify and control the collinearity in $\boldsymbol{X}$ and hence no theory including model selection process (MSP) would fill this gap unless $\boldsymbol{X}$ is controlled in view of sampling theory. In this paper, first introducing a new concept of "empirically effective modelling" (EEM), we propose our EEM methodology (EEM-M) as an integrated process of two MSPs with data $(\boldsymbol{y^o,X})$ given. The first MSP uses $\boldsymbol{X}$ only, called the XMSP, and pre-selects a class $\scr{D}$ of models with individually inefficiency-controlled and collinearity-controlled OLS estimates, where the corresponding two controlling variables are chosen from predictive standard error of each estimate. Next, defining an inefficiency-collinearity risk index for each model, a partial ordering is introduced onto the set of models to compare without using $\boldsymbol{y^o}$, where the better-ness and admissibility of models are discussed. The second MSP is a commonly used MSP that uses $(\boldsymbol{y^o,X})$, and evaluates total model performance as a whole by such AIC, BIC, etc. to select an optimal model from $\scr{D}$. Third, to materialize the XMSP, two algorithms are proposed.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑