模型比较与校准评估:机器学习与精算实践中一致评分函数的用户指南
Model Comparison and Calibration Assessment: User Guide for Consistent Scoring Functions in Machine Learning and Actuarial Practice
AI总结:
本指南阐明模型校准评估与比较的统计方法,强调按预测目标选择一致评分函数,并通过工伤赔偿和客户流失案例提供实践指导。
摘要:
精算师和数据科学家的主要任务之一是为某些现象(如保险中的索赔金额或索赔次数)构建良好的预测模型。这些模型理想地利用给定的特征信息来提高预测的准确性。本用户指南重新审视并阐明了统计技术,一方面用于评估模型的校准或充分性,另一方面用于比较和排序不同模型。在此过程中,它强调了事先指定预测目标泛函(如均值或分位数)的重要性,并在模型比较中选择与该目标泛函一致的评分函数。提供了评分函数实际选择的指导。为了弥合科学与日常应用实践之间的差距,它主要侧重于对现有结果和最佳实践的启发性展示。这些结果通过两个关于工伤赔偿和客户流失的真实数据案例研究进行了说明和例证。
英文摘要:
One of the main tasks of actuaries and data scientists is to build good predictive models for certain phenomena such as the claim size or the number of claims in insurance. These models ideally exploit given feature information to enhance the accuracy of prediction. This user guide revisits and clarifies statistical techniques to assess the calibration or adequacy of a model on the one hand, and to compare and rank different models on the other hand. In doing so, it emphasises the importance of specifying the prediction target functional at hand a priori (e.g. the mean or a quantile) and of choosing the scoring function in model comparison in line with this target functional. Guidance for the practical choice of the scoring function is provided. Striving to bridge the gap between science and daily practice in application, it focuses mainly on the pedagogical presentation of existing results and of best practice. The results are accompanied and illustrated by two real data case studies on workers' compensation and customer churn.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。