arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2410.08375cs.CL
收藏

面向社交媒体自杀风险检测的Transformer模型评估

Evaluating Transformer Models for Suicide Risk Detection on Social Media

Adam Mickiewicz University(亚当·密茨凯维奇大学);Poznan University of Medical Sciences(波兹南医科大学);Kazimierz Wielki University(卡齐米日·维利基大学)

Jakub Pokrywka, Jeremi I. Kaczmarek, Edward J. Gorzelańczyk

AI总结:

本研究针对社交媒体自杀风险检测任务,实验了三种Transformer模型配置,发现微调GPT-4o表现最优,在IEEE BigData 2024 Cup竞赛中获第二名,证明通用模型经少量调优即可有效用于该检测任务。

摘要:

社交媒体中的自杀风险检测是一项具有潜在救命意义的关键任务。本文介绍了kubapok团队提交至“IEEE BigData 2024 Cup:社交媒体自杀风险检测”竞赛的研究工作,旨在利用前沿自然语言处理方案识别社交媒体帖子中的自杀风险。我们实验了三种基于Transformer的模型配置:微调DeBERTa、结合思维链(CoT)和少样本提示的GPT-4o,以及微调GPT-4o。该任务需将社交媒体帖子分为四类:指标(indicator)、意念(ideation)、行为(behavior)和企图(attempt)。研究结果表明,微调GPT-4o模型的表现优于另外两种配置,在识别自杀风险方面达到了高精度。值得注意的是,我们的模型在竞赛中获得了第二名。通过证明简洁的通用模型可取得前沿结果,我们提出这类模型只需最少调优,就有望成为社交媒体自动化自杀风险检测的有效解决方案。

英文摘要:

The detection of suicide risk in social media is a critical task with potential life-saving implications. This paper presents a study on leveraging state-of-the-art natural language processing solutions for identifying suicide risk in social media posts as a submission for the "IEEE BigData 2024 Cup: Detection of Suicide Risk on Social Media" conducted by the kubapok team. We experimented with the following configurations of transformer-based models: fine-tuned DeBERTa, GPT-4o with CoT and few-shot prompting, and fine-tuned GPT-4o. The task setup was to classify social media posts into four categories: indicator, ideation, behavior, and attempt. Our findings demonstrate that the fine-tuned GPT-4o model outperforms two other configurations, achieving high accuracy in identifying suicide risk. Notably, our model achieved second place in the competition. By demonstrating that straightforward, general-purpose models can achieve state-of-the-art results, we propose that these models, combined with minimal tuning, may have the potential to be effective solutions for automated suicide risk detection on social media.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑