arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2402.02262cs.CLcs.AI
收藏

数据质量很重要:使用RoBERTa-CNN在社交媒体帖子中进行自杀意图检测

Data Quality Matters: Suicide Intention Detection on Social Media Posts Using RoBERTa-CNN

University of Denver(丹佛大学)

Emily Lin, Jian Sun, Hsingyu Chen, Mohammad H. Mahoor

AI总结:

本文提出利用RoBERTa-CNN模型识别社交媒体帖子中的自杀意图,通过手动或OpenAI API清理数据噪声提升质量,在相关数据集上达到98%平均准确率,证明了数据质量对模型训练的重要性。

摘要:

自杀仍然是一个紧迫的全球健康问题,需要创新的方法进行早期检测和干预。本文通过提出一种利用最先进的RoBERTa-CNN模型的全新深度学习方法,专注于识别SuicideWatch subreddit中帖子的自杀意图。鲁棒优化的BERT预训练方法(RoBERTa)擅长捕捉文本细微差别并在文本中形成语义关系。剩余的卷积神经网络(CNN)头部增强了RoBERTa从大量数据集中辨别关键模式的能力。为了评估RoBERTa-CNN,我们在Suicide and Depression Detection数据集上进行了实验,取得了可喜的结果。例如,RoBERTa-CNN实现了98%的平均准确率,标准差(STD)为0.0009。此外,我们发现数据质量显著影响稳健模型的训练。为了提高数据质量,我们通过手动清理或利用OpenAI API,在保留文本上下文内容的同时去除了文本数据中的噪声。

英文摘要:

Suicide remains a pressing global health concern, necessitating innovative approaches for early detection and intervention. This paper focuses on identifying suicidal intentions in posts from the SuicideWatch subreddit by proposing a novel deep-learning approach that utilizes the state-of-the-art RoBERTa-CNN model. The robustly Optimized BERT Pretraining Approach (RoBERTa) excels at capturing textual nuances and forming semantic relationships within the text. The remaining Convolutional Neural Network (CNN) head enhances RoBERTa's capacity to discern critical patterns from extensive datasets. To evaluate RoBERTa-CNN, we conducted experiments on the Suicide and Depression Detection dataset, yielding promising results. For instance, RoBERTa-CNN achieves a mean accuracy of 98% with a standard deviation (STD) of 0.0009. Additionally, we found that data quality significantly impacts the training of a robust model. To improve data quality, we removed noise from the text data while preserving its contextual content through either manually cleaning or utilizing the OpenAI API.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑