arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1710.00596stat.MEstat.CO
收藏

高维多数据源的可扩展贝叶斯回归

Scalable Bayesian regression in high dimensions with multiple data sources

Konstantinos Perrakis, Sach Mukherjee, the Alzheimers Disease Neuroimaging Initiative

摘要:

高维回归的应用通常涉及多个来源或类型的协变量。我们提出了这种设置的方法,强调“宽数据”制度与大的总维数p和样本量n<<p。我们专注于一个灵活的岭型收缩水平,具体到每个数据类型或源,并自动设置经验贝叶斯。所有的估计,包括设定的收缩水平,制定主要是在内积矩阵的大小为n × n。这使得计算在宽数据范围内高效,并允许扩展到具有数百万特征的问题。此外,所提出的程序是免费的用户设置的调谐参数。我们展示了如何稀疏可以通过后处理的贝叶斯输出,通过约束最小化的某个库尔贝克-莱布勒散度。这会产生稀疏的解决方案与自适应,特定于源的收缩,包括一个封闭的形式的变体,规模非常大的p。我们提出的实证结果,从模拟研究的基础上,真实的数据和案例研究阿尔茨海默氏症,涉及数百万的功能和多个数据源。

英文摘要:

Applications of high-dimensional regression often involve multiple sources or types of covariates. We propose methodology for this setting, emphasizing the "wide data" regime with large total dimensionality p and sample size n<<p. We focus on a flexible ridge-type prior with shrinkage levels that are specific to each data type or source and that are set automatically by empirical Bayes. All estimation, including setting of shrinkage levels, is formulated mainly in terms of inner product matrices of size n x n. This renders computation efficient in the wide data regime and allows scaling to problems with millions of features. Furthermore, the proposed procedures are free of user-set tuning parameters. We show how sparsity can be achieved by post-processing of the Bayesian output via constrained minimization of a certain Kullback-Leibler divergence. This yields sparse solutions with adaptive, source-specific shrinkage, including a closed-form variant that scales to very large p. We present empirical results from a simulation study based on real data and a case study in Alzheimer's disease involving millions of features and multiple data sources.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑