arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2501.03370cs.CLcs.AIcs.HCcs.LG
收藏

用于社交媒体社会支持检测的先进机器学习技术

Advanced Machine Learning Techniques for Social Support Detection on Social Media

Portland State University(波特兰州立大学)

Olga Kolesnikova, Moein Shahiki Tash, Zahra Ahani, Ameeta Agrawal, Raul Monroy, Grigori Sidorov

AI总结:

本文面向社交媒体社会支持检测构建三项分类任务,采用 K-means 平衡数据,并比较 transformers 与 GPT3/GPT4/GPT4-o 零样本方法,基于 transformer 的方法性能最优且提升了 macro F1。

摘要:

社交媒体的广泛使用凸显了理解其影响的必要性,尤其是在线社会支持的作用。本研究使用了一个聚焦在线社会支持的数据集,其中包含对社交媒体上社会支持内容的二分类和多分类。社会支持分类被划分为三个任务。第一个任务聚焦于区分支持性与非支持性内容。第二个任务旨在识别支持是指向个人还是群体。第三个任务对社会支持的具体类型进行分类,将其归入 Nation、LGBTQ、Black people、Women、Religion 和 Other(如果不属于前述类别)等类别。为解决这些任务中的数据不平衡问题,我们采用 K-means 聚类来平衡数据集,并将结果与原始不平衡数据进行比较。我们利用先进机器学习技术,包括 transformers 以及使用 GPT3、GPT4 和 GPT4-o 的零样本学习方法,在多种情境下预测社会支持水平。通过跨不同学习方法的基线模型评估该数据集的有效性,其中基于 transformer 的方法表现出更优性能。此外,与先前使用传统机器学习并结合心理语言学和基于一元语法的 TF-IDF 值的研究相比,我们在第二个任务上的 macro F1 分数提升了 0.4%,在第三个任务上提升了 0.7%。

英文摘要:

The widespread use of social media highlights the need to understand its impact, particularly the role of online social support. This study uses a dataset focused on online social support, which includes binary and multiclass classifications of social support content on social media. The classification of social support is divided into three tasks. The first task focuses on distinguishing between supportive and non-supportive. The second task aims to identify whether the support is directed toward an individual or a group. The third task categorizes the specific type of social support, grouping it into categories such as Nation, LGBTQ, Black people, Women, Religion, and Other (if it does not fit into the previously mentioned categories). To address data imbalances in these tasks, we employed K-means clustering for balancing the dataset and compared the results with the original unbalanced data. Using advanced machine learning techniques, including transformers and zero-shot learning approaches with GPT3, GPT4, and GPT4-o, we predict social support levels in various contexts. The effectiveness of the dataset is evaluated using baseline models across different learning approaches, with transformer-based methods demonstrating superior performance. Additionally, we achieved a 0.4\% increase in the macro F1 score for the second task and a 0.7\% increase for the third task, compared to previous work utilizing traditional machine learning with psycholinguistic and unigram-based TF-IDF values.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑