arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2206.02014cs.CL
收藏

基于Transformer的自然语言处理在精算中的应用:在精算场景中使用文本特征的案例研究

Actuarial Applications of Natural Language Processing Using Transformers: Case Studies for Using Text Features in an Actuarial Context

AT Analytics AG(AT分析公司);Swiss Re(瑞士再保险公司)

Andreas Troxler, Jürg Schelldorfer

AI总结:

本教程展示了如何利用基于Transformer的NLP模型将多语言、长文本的事故与保险索赔描述融入精算分类和回归任务,并通过微调与少样本方法(含ChatGPT)验证了迁移学习在精算实践中的有效性。

摘要:

本教程演示了将文本数据纳入精算分类和回归任务的工作流程。主要关注采用基于Transformer模型的方法。使用了一个平均长度为400词、提供英语和德语版本的车祸描述数据集,以及一个包含简短财产保险索赔描述的数据集来演示这些技术。案例研究解决了与多语言环境和长输入序列相关的挑战。它们还展示了通过将模型微调到应用领域或特定预测任务来解释模型输出、评估和改进模型性能的方法。最后,本教程提供了在没有或仅有少量标注数据的情况下处理分类任务的实用方法,包括但不限于ChatGPT。使用现成的自然语言处理(NLP)模型的语言理解能力,仅需最少的预处理和微调即可获得的结果清楚地证明了迁移学习在实际应用中的强大能力。

英文摘要:

This tutorial demonstrates workflows to incorporate text data into actuarial classification and regression tasks. The main focus is on methods employing transformer-based models. A dataset of car accident descriptions with an average length of 400 words, available in English and German, and a dataset with short property insurance claims descriptions are used to demonstrate these techniques. The case studies tackle challenges related to a multi-lingual setting and long input sequences. They also show ways to interpret model output, to assess and improve model performance, by fine-tuning the models to the domain of application or to a specific prediction task. Finally, the tutorial provides practical approaches to handle classification tasks in situations with no or only few labeled data, including but not limited to ChatGPT. The results achieved by using the language-understanding skills of off-the-shelf natural language processing (NLP) models with only minimal pre-processing and fine-tuning clearly demonstrate the power of transfer learning for practical applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑