arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1303.0642stat.MLcs.LG
收藏

贝叶斯压缩回归

Bayesian Compressed Regression

Rajarshi Guhaniyogi, David B. Dunson

摘要:

作为高维回归中变量选择或收缩的替代方案,我们建议在分析之前随机压缩预测因子。这极大地减少了存储和计算瓶颈,当预测器可以投影到低维线性子空间时表现良好,并且关于响应的信息损失最小。与现有的贝叶斯降维方法相反,压缩数据的精确后验分布条件是分析可用的,加速了许多数量级的计算,同时还绕过了由于MCMC的收敛和混合问题而引起的鲁棒性问题。模型平均用于降低对随机投影矩阵的敏感性,同时适应子空间维度中的不确定性。强有力的理论支持的方法显示近参数收敛速度的预测密度在大p小n渐近范例。在模拟和实际数据应用中说明了相对于竞争对手的实际性能。

英文摘要:

As an alternative to variable selection or shrinkage in high dimensional regression, we propose to randomly compress the predictors prior to analysis. This dramatically reduces storage and computational bottlenecks, performing well when the predictors can be projected to a low dimensional linear subspace with minimal loss of information about the response. As opposed to existing Bayesian dimensionality reduction approaches, the exact posterior distribution conditional on the compressed data is available analytically, speeding up computation by many orders of magnitude while also bypassing robustness issues due to convergence and mixing problems with MCMC. Model averaging is used to reduce sensitivity to the random projection matrix, while accommodating uncertainty in the subspace dimension. Strong theoretical support is provided for the approach by showing near parametric convergence rates for the predictive density in the large p small n asymptotic paradigm. Practical performance relative to competitors is illustrated in simulations and real data applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑