arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2212.13629cs.LGstat.ML
收藏

分位数风险控制:一个限制高损失预测概率的灵活框架

Quantile Risk Control: A Flexible Framework for Bounding the Probability of High-Loss Predictions

Princeton University(普林斯顿大学);Columbia University(哥伦比亚大学);Harvard University(哈佛大学);University of Toronto(多伦多大学);Vector Institute(向量研究所)

Jake C. Snell, Thomas P. Zollo, Zhun Deng, Toniann Pitassi, Richard Zemel

摘要:

严格保证预测算法的性能是必要的,以确保其负责任的使用。以前的工作主要集中在边界的预测的预期损失,但这是不够的,在许多风险敏感的应用程序中,错误的分布是很重要的。在这项工作中,我们提出了一个灵活的框架,以产生一个家庭的界限的分位数的损失分布的预测。我们的方法利用了观测损失值的顺序统计量,而不是仅仅依赖于样本均值。我们表明,分位数是量化预测性能的一种信息方式,我们的框架适用于各种基于分位数的指标,每个指标都针对数据分布的重要子集。我们分析了我们提出的方法的理论特性,并证明了它能够严格控制几个真实世界的数据集上的损失分位数。

英文摘要:

Rigorous guarantees about the performance of predictive algorithms are necessary in order to ensure their responsible use. Previous work has largely focused on bounding the expected loss of a predictor, but this is not sufficient in many risk-sensitive applications where the distribution of errors is important. In this work, we propose a flexible framework to produce a family of bounds on quantiles of the loss distribution incurred by a predictor. Our method takes advantage of the order statistics of the observed loss values rather than relying on the sample mean alone. We show that a quantile is an informative way of quantifying predictive performance, and that our framework applies to a variety of quantile-based metrics, each targeting important subsets of the data distribution. We analyze the theoretical properties of our proposed method and demonstrate its ability to rigorously control loss quantiles on several real-world datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑