arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1607.02613cs.ITmath.ITmath.STstat.TH
收藏

贝叶斯高维线性回归新方法

New approach to Bayesian high-dimensional linear regression

Shirin Jalali, Arian Maleki

摘要:

考虑在$X^n$的分布已知的假设下,从$m$响应变量$Y^m = AX^n+Z^m$估计由平稳过程生成的参数$X^n \in \mathbb{R}^n $的问题。这是贝叶斯线性回归问题的最一般版本。缺乏计算上可行的算法,可以采用通用的先验分布,并提供一个很好的估计$X^n$,限制了研究人员用来模拟数据的分布集。本文提出了一种新的方案Q-MAP。新方法具有以下特点:(i)它与无噪声环境下流行的MAP估计有相似之处。(ii)在无噪声环境下,当$X^n$具有独立同分布的分量时,它实现了“渐近最优性能”。(iii)它的规模有利的尺寸的问题,因此适用于高维设置。(iv)Q-MAP优化的解决方案可以通过所提出的迭代算法来找到,该算法对响应变量中的误差(噪声)具有可证明的鲁棒性。

英文摘要:

Consider the problem of estimating parameters $X^n \in \mathbb{R}^n $, generated by a stationary process, from $m$ response variables $Y^m = AX^n+Z^m$, under the assumption that the distribution of $X^n$ is known. This is the most general version of the Bayesian linear regression problem. The lack of computationally feasible algorithms that can employ generic prior distributions and provide a good estimate of $X^n$ has limited the set of distributions researchers use to model the data. In this paper, a new scheme called Q-MAP is proposed. The new method has the following properties: (i) It has similarities to the popular MAP estimation under the noiseless setting. (ii) In the noiseless setting, it achieves the "asymptotically optimal performance" when $X^n$ has independent and identically distributed components. (iii) It scales favorably with the dimensions of the problem and therefore is applicable to high-dimensional setups. (iv) The solution of the Q-MAP optimization can be found via a proposed iterative algorithm which is provably robust to the error (noise) in the response variables.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑