arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2008.01543cs.CLcs.LGcs.SDeess.ASstat.ML
收藏

基于文本的心理健康访谈分类--并列最新进展

Text-based classification of interviews for mental health -- juxtaposing the state of the art

University of Amsterdam(阿姆斯特丹大学)

Joppe Valentijn Wouts

摘要:

目前,精神疾病分类的最新技术是基于基于音频的分类。本文旨在设计和评估一个最先进的文本分类网络。假设是,一个精心设计的基于文本的方法构成了一个强大的竞争对国家的最先进的音频为基础的方法。荷兰语自然语言模型受到预训练单语NLP模型稀缺性的限制,因此荷兰语自然语言模型对句子的长范围语义依赖性的捕获率较低。针对这个问题,本文提出了belabBERT,一个新的荷兰语语言模型,扩展了RoBERTa[15]体系结构。belabBERT是在一个大型的荷兰语语料库(+32GB)上训练的。在评估了基于文本的分类的强度之后,本文做了一个简单的探索,将该框架扩展到基于文本和音频的混合分类。这个混合框架的目标是展示一个非常基本的音频分类网络的混合原理。总体目标是通过证明新的基于文本的分类已经是一个强大的独立解决方案,为混合精神疾病分类奠定基础。

英文摘要:

Currently, the state of the art for classification of psychiatric illness is based on audio-based classification. This thesis aims to design and evaluate a state of the art text classification network on this challenge. The hypothesis is that a well designed text-based approach poses a strong competition against the state-of-the-art audio based approaches. Dutch natural language models are being limited by the scarcity of pre-trained monolingual NLP models, as a result Dutch natural language models have a low capture of long range semantic dependencies over sentences. For this issue, this thesis presents belabBERT, a new Dutch language model extending the RoBERTa[15] architecture. belabBERT is trained on a large Dutch corpus (+32GB) of web crawled texts. After this thesis evaluates the strength of text-based classification, a brief exploration is done, extending the framework to a hybrid text- and audio-based classification. The goal of this hybrid framework is to show the principle of hybridisation with a very basic audio-classification network. The overall goal is to create the foundations for a hybrid psychiatric illness classification, by proving that the new text-based classification is already a strong stand-alone solution.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑