arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2306.01618cs.LG
收藏

通过基于NLP的聚类和机器学习分析信用风险模型问题:来自验证报告的洞见

Analyzing Credit Risk Model Problems through NLP-Based Clustering and Machine Learning: Insights from Validation Reports

University of Warsaw(华沙大学);ING Hubs Poland(波兰ING中心);Warsaw School of Economics(华沙经济学院)

Szymon Lis, Mariusz Kubkowski, Olimpia Borkowska, Dobromił Serwa, Jarosław Kurpanik

AI总结:

本文基于657条银行模型验证发现,利用NLP嵌入、聚类及逻辑回归和XGBoost等方法,自动识别并分类信用风险模型问题的验证维度与严重程度。

摘要:

本文探讨使用聚类方法和机器学习算法(包括自然语言处理,NLP),借助验证报告中包含的文本信息,识别并分类信用风险模型中发现的问题。研究使用一个独特数据集,包含某大型国际银行集团验证团队在2019年1月至2022年12月期间提出的657项发现。这些发现被划分为九个验证维度,并由验证人员运用其专家知识赋予严重程度等级。作者针对发现的标题和观察意见生成嵌入,使用四种不同的预训练模型,包括来自TensorFlow Hub的“module_url”,以及来自SentenceTransformer库的三个模型,即“all-mpnet-base-v2”“all-MiniLM-L6-v2”和“paraphrase-mpnet-base-v2”。本文采用并比较多种聚类方法,将具有相似特征的发现分组,从而识别每个验证维度和严重程度内的常见问题。研究结果表明,聚类是识别和分类信用风险模型问题的有效方法,准确率高于60%。作者还采用包括逻辑回归和XGBoost在内的机器学习算法来预测验证维度及其严重程度,其中XGBoost算法达到80%的准确率。此外,研究识别出可预测验证维度和严重程度的前10个词语。总体而言,本文的贡献在于证明了聚类和机器学习在分析验证报告文本信息方面的实用性,并为信用风险模型开发与验证中遇到的问题类型提供了洞见。

英文摘要:

This paper explores the use of clustering methods and machine learning algorithms, including Natural Language Processing (NLP), to identify and classify problems identified in credit risk models through textual information contained in validation reports. Using a unique dataset of 657 findings raised by validation teams in a large international banking group between January 2019 and December 2022. The findings are classified into nine validation dimensions and assigned a severity level by validators using their expert knowledge. The authors use embedding generation for the findings' titles and observations using four different pre-trained models, including "module\_url" from TensorFlow Hub and three models from the SentenceTransformer library, namely "all-mpnet-base-v2", "all-MiniLM-L6-v2", and "paraphrase-mpnet-base-v2". The paper uses and compares various clustering methods in grouping findings with similar characteristics, enabling the identification of common problems within each validation dimension and severity. The results of the study show that clustering is an effective approach for identifying and classifying credit risk model problems with accuracy higher than 60\%. The authors also employ machine learning algorithms, including logistic regression and XGBoost, to predict the validation dimension and its severity, achieving an accuracy of 80\% for XGBoost algorithm. Furthermore, the study identifies the top 10 words that predict a validation dimension and severity. Overall, this paper makes a contribution by demonstrating the usefulness of clustering and machine learning for analyzing textual information in validation reports, and providing insights into the types of problems encountered in the development and validation of credit risk models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑