arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2110.00816cs.LG
收藏

基于表示学习的校正多输出分位数回归

Calibrated Multiple-Output Quantile Regression with Representation Learning

Technion—Israel Institute of Technology(以色列理工学院);University of California, Berkeley(加州大学伯克利分校)

Shai Feldman, Stephen Bates, Yaniv Romano

摘要:

我们开发了一种方法来生成预测区域,覆盖一个多变量的响应变量与用户指定的概率。我们的工作由两部分组成。首先,我们使用深度生成模型来学习具有单峰分布的响应的表示。现有的多输出分位数回归方法在这种情况下是有效的,所以我们将它们应用于学习的表示,然后将解决方案转换到响应的原始空间。这个过程产生了一个灵活的信息区域,可以具有任意形状,这是现有方法所缺乏的属性。其次,我们提出了一个扩展的共形预测的多变量响应设置,修改任何方法返回一个预先指定的覆盖水平集。对于任何分布,在有限样本的情况下,理论上保证了所需的覆盖率。在真实数据和合成数据上进行的实验表明,与现有技术相比,我们的方法构建的区域明显较小。

英文摘要:

We develop a method to generate predictive regions that cover a multivariate response variable with a user-specified probability. Our work is composed of two components. First, we use a deep generative model to learn a representation of the response that has a unimodal distribution. Existing multiple-output quantile regression approaches are effective in such cases, so we apply them on the learned representation, and then transform the solution to the original space of the response. This process results in a flexible and informative region that can have an arbitrary shape, a property that existing methods lack. Second, we propose an extension of conformal prediction to the multivariate response setting that modifies any method to return sets with a pre-specified coverage level. The desired coverage is theoretically guaranteed in the finite-sample case for any distribution. Experiments conducted on both real and synthetic data show that our method constructs regions that are significantly smaller compared to existing techniques.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑