arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2209.08848q-fin.CPcs.AIcs.LG
收藏

置信度预测的两阶段模型

Two-stage Modeling for Prediction with Confidence

Zu Chongzhi Center for Mathematics and Computational Sciences(祖冲之数学与计算科学中心);Duke Kunshan University(昆山杜克大学)

Dangxing Chen

摘要:

神经网络的使用在各种各样的应用中已经非常成功。然而,最近观察到,很难概括分布移位条件下的神经网络的性能。已作出若干努力,以确定潜在的分发外投入。尽管现有文献在图像和文本数据方面取得了重大进展,但金融一直被忽视。本文的目的是研究分布转移的信用评分问题,最重要的金融应用之一。对于潜在的分布移动问题,我们提出了一个新的两阶段模型。使用分布外检测方法,首先将数据分为置信集和非置信集。作为第二步,我们利用领域知识与均值方差优化,以提供可靠的界限不自信的样本。使用实证结果,我们证明了我们的模型为绝大多数数据集提供了可靠的预测。只有一小部分数据集本质上很难判断,我们把它们留给人类来判断。基于两阶段模型,做出了高度可信的预测,并显著降低了与模型相关的潜在风险。

英文摘要:

The use of neural networks has been very successful in a wide variety of applications. However, it has recently been observed that it is difficult to generalize the performance of neural networks under the condition of distributional shift. Several efforts have been made to identify potential out-of-distribution inputs. Although existing literature has made significant progress with regard to images and textual data, finance has been overlooked. The aim of this paper is to investigate the distribution shift in the credit scoring problem, one of the most important applications of finance. For the potential distribution shift problem, we propose a novel two-stage model. Using the out-of-distribution detection method, data is first separated into confident and unconfident sets. As a second step, we utilize the domain knowledge with a mean-variance optimization in order to provide reliable bounds for unconfident samples. Using empirical results, we demonstrate that our model offers reliable predictions for the vast majority of datasets. It is only a small portion of the dataset that is inherently difficult to judge, and we leave them to the judgment of human beings. Based on the two-stage model, highly confident predictions have been made and potential risks associated with the model have been significantly reduced.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑