arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2201.03077stat.ME
收藏

回归模型中的信息借用

Information Borrowing in Regression Models

Amy Zhang, Le Bao, Michael J. Daniels

摘要:

模型开发通常需要考虑数据结构、主题因素、模型假设和拟合优度。要诊断这些因素中的任何一个的问题,在更细粒度的级别上理解回归模型估计值可能会有所帮助。我们提出了一种新的方法分解点估计从回归模型通过放置在数据集群的权重。权重仅由模型规格和数据可用性提供,因此可用于将数据不平衡和模型假设的影响与实际模型估计值明确联系起来。在现有文献中,在线性模型中,权重矩阵被理解为帽子矩阵。我们将其扩展到贝叶斯分层回归模型,通过随机效应之间的协方差,将先验信息和复杂的依赖结构。我们表明,模型的权重,我们称之为借款因素,概括收缩和信息借用所有回归模型。相比之下,帽子矩阵的重点主要放在表示杠杆金额的对角元素上。我们还提供了汇总借款因素的指标,这些指标实际上很有用。我们提出的理论属性的借款因素和相关的指标,并证明他们的用法在两个例子。通过明确量化借用和收缩,研究人员可以更好地整合领域知识,评估模型性能和数据属性(如数据不平衡或影响点)的影响。

英文摘要:

Model development often takes data structure, subject matter considerations, model assumptions, and goodness of fit into consideration. To diagnose issues with any of these factors, it can be helpful to understand regression model estimates at a more granular level. We propose a new method for decomposing point estimates from a regression model via weights placed on data clusters. The weights are informed only by the model specification and data availability and thus can be used to explicitly link the effects of data imbalance and model assumptions to actual model estimates. The weight matrix has been understood in linear models as the hat matrix in the existing literature. We extend it to Bayesian hierarchical regression models that incorporate prior information and complicated dependence structures through the covariance among random effects. We show that the model weights, which we call borrowing factors, generalize shrinkage and information borrowing to all regression models. In contrast, the focus of the hat matrix has been mainly on the diagonal elements indicating the amount of leverage. We also provide metrics that summarize the borrowing factors and are practically useful. We present the theoretical properties of the borrowing factors and associated metrics and demonstrate their usage in two examples. By explicitly quantifying borrowing and shrinkage, researchers can better incorporate domain knowledge and evaluate model performance and the impacts of data properties such as data imbalance or influential points.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑