The detection of suicide risk in social media is a critical task with potential life-saving implications. This paper presents a study on leveraging state-of-the-art natural language processing solutions for identifying suicide risk in social media posts as a submission for the "IEEE BigData 2024 Cup: Detection of Suicide Risk on Social Media" conducted by the kubapok team. We experimented with the following configurations of transformer-based models: fine-tuned DeBERTa, GPT-4o with CoT and few-shot prompting, and fine-tuned GPT-4o. The task setup was to classify social media posts into four categories: indicator, ideation, behavior, and attempt. Our findings demonstrate that the fine-tuned GPT-4o model outperforms two other configurations, achieving high accuracy in identifying suicide risk. Notably, our model achieved second place in the competition. By demonstrating that straightforward, general-purpose models can achieve state-of-the-art results, we propose that these models, combined with minimal tuning, may have the potential to be effective solutions for automated suicide risk detection on social media.
Protective Factor-Aware Dynamic Influence Learning for Suicide Risk Prediction on Social Media
IEEE Publication Technology Department(IEEE出版技术部);Department of Computing(计算系);The Hong Kong Polytechnic University(香港理工大学);Department of Computer Science, Technology(计算机科学与技术系);Tsinghua University(清华大学);Department of Social and Behavioural Sciences(社会科学与行为科学系);City University of Hong Kong(香港城市大学)
SOS-1K: A Fine-grained Suicide Risk Classification Dataset for Chinese Social Media Analysis
School of Software Engineering, Beijing University of Technology(北京工业大学软件学院);School of Nursing, Wuhan University(武汉大学护理学院);Sorbonne Université(索邦大学);Institut du Cerveau - Paris Brain Institute - ICM(大脑研究所-巴黎脑研究所-ICM);CNRS(法国国家科学研究中心);Inria(法国国家信息与自动化研究所);Inserm(法国国家健康与医学研究院);AP-HP(巴黎公共医疗集团);Hôpital de la Pitié Salpêtrière(皮蒂-萨尔皮特里医院)
Evaluating Reasoning LLMs for Suicide Screening with the Columbia-Suicide Severity Rating Scale
Ira A. Fulton Schools of Engineering Arizona State University(亚利桑那州立大学工程学院);Heinz College of Information Systems and Public Policy Carnegie Mellon University(卡内基梅隆大学信息系统与公共政策学院);School of Education and Counseling Psychology Santa Clara University(圣克拉拉大学教育与咨询心理学学院)
Bored to Death: Artificial Intelligence Research Reveals the Role of Boredom in Suicide Behavior
Technion – Israel Institute of Technology(以色列理工学院);University of Cambridge(剑桥大学);Reichman University(赖希曼大学);The Hebrew University of Jerusalem(耶路撒冷希伯来大学)
Two-Stage Voting for Robust and Efficient Suicide Risk Detection on Social Media
Department of Electrical and Computer Engineering(电气与计算机工程系);Department of Informatics and Networked Systems(信息与网络系统系);University of Pittsburgh(匹兹堡大学);Department of Psychiatry(精神病学系);Tandon School of Engineering(塔能工程学院);New York University(纽约大学)
Detecting potentially harmful and protective suicide-related content on twitter: A machine learning approach
Medical University of Vienna(维也纳医科大学);Complexity Science Hub Vienna(维也纳复杂性科学中心);Graz University of Technology(格拉茨工业大学);Institute of Globally Distributed Open Research and Education(全球分布式开放研究与教育研究所);Vienna University of Technology(维也纳工业大学)
FigSIM: A Dataset for Fine-grained Suicide Severity and Figurative Language in Suicide Memes
School of Computing and Information Systems, University of Melbourne, Australia(墨尔本大学计算与信息学院);Orygen, The National Centre of Excellence in Youth Mental Health, Australia(奥里根青少年心理健康国家研究中心);Centre for Youth Mental Health, University of Melbourne, Australia(墨尔本大学青少年心理健康中心);O’Donnell School of Public Health, UT Southwestern Medical Center, United States(奥唐奈公共卫生学院,西南医学中心)
Using Linguistic Features to Estimate Suicide Probability of Chinese Microblog Users
Institute of Psychology, Chinese Academy of Sciences(中国科学院心理研究所);University of Jinan(济南大学);China Networking Information Center, Chinese Academy of Sciences(中国科学院计算机网络信息中心);Institute of Population Research, Peking University(北京大学人口研究所)
Supervised Learning and Large Language Model Benchmarks on Mental Health Datasets: Cognitive Distortions and Suicidal Risks in Chinese Social Media
School of Software Engineering, Beijing University of Technology(北京工业大学软件学院);School of Nursing, Wuhan University(武汉大学护理学院);Sorbonne Université, Institut du Cerveau – Paris Brain Institute - ICM, CNRS, Inria, Inserm, AP-HP, Hôpital de la Pitié-Salpêtrière(索邦大学、巴黎脑研究所、法国国家科学研究中心、法国国家计算机与自动化研究所、法国国家健康与医学研究院、巴黎公立医院集团、皮蒂-萨尔皮特里耶医院)
Evaluating Cognitive-Behavioral Fixation via Multimodal User Viewing Patterns on Social Media
State Key Laboratory of AI Safety, Institute of Computing Technology, Chinese Academy of Sciences(中国科学院人工智能安全国家重点实验室,计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学)
K-Bench: a clinically calibrated benchmark for evaluating large language models in high-risk mental health conversations
University of Roehampton(罗汉普顿大学);Kivira Health;University of Hertfordshire(赫特福德大学);University of Surrey(萨里大学);University of Bedfordshire(贝德福德大学);Tavistock Relationships(塔维斯托克关系中心);InsideOut
Guardians of Discourse: Evaluating LLMs on Multilingual Offensive Language Detection
School of AI and Advanced Computing, Xi’an Jiaotong-Liverpool University(西交利物浦大学人工智能与先进计算学院);School of Advanced Technology, Xi’an Jiaotong-Liverpool University(西交利物浦大学先进技术学院);College of Computer Science and Technology, Zhejiang University of Technology(浙江工业大学计算机科学与技术学院);Australian Artificial Intelligence Institute, University of Technology Sydney(悉尼科技大学澳大利亚人工智能研究所)
OPOR-Bench: Evaluating Large Language Models on Online Public Opinion Report Generation
Communication University of China(中国传媒大学);Harbin Institute of Technology(哈尔滨工业大学);China Academy of Railway Sciences Corporation Limited(中国铁道科学研究院集团有限公司);School of Engineering, Santa Clara University(圣克拉拉大学工程学院)
Document Topic Alignment Metrics for Evaluating Topic Models of Short-Text Public Health Communications on Social Media
College of Computing and Informatics(计算与信息学院);The University of North Carolina at Charlotte(北卡罗来纳大学夏洛特分校);Department of Public Health and Health Administration(公共卫生与健康管理系)