arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2411.04532cs.LG
收藏

使用大数据技术对社交网络帖子进行实时压力检测

Real-time stress detection on social network posts using big data technology

University of Information Technology(信息科技大学);Vietnam National University Ho Chi Minh City(胡志明市越南国家大学)

Hai-Yen Phan Nguyen, Phi-Lan Ly, Duc-Manh Le, Trong-Hop Do

AI总结:

本研究利用大数据技术构建实时压力检测系统,基于Dreaddit数据集,采用逻辑回归模型,在流式数据上实现69.39%的准确率和68.97的F1分数。

摘要:

在现代生活背景下,特别是在工业4.0时代的在线空间中,情绪和心情经常通过社交媒体帖子传达。在这些平台上分享故事、想法和感受的趋势产生了庞大且有前景的大数据来源。这为应用技术开发更自动化和准确的社交媒体用户压力检测方法的研究带来了挑战和机遇。在本研究中,我们开发了一个实时系统,用于检测在线帖子中的压力,使用了“Dreaddit:用于社交媒体压力分析的Reddit数据集”,该数据集包含来自五个不同Reddit领域的187,444篇帖子。每个领域包含有压力和无压力内容的文本,展示了压力的各种表达方式。创建了一个包含3,553行的标记数据集用于训练。利用Apache Kafka、PySpark和AirFlow来构建和部署模型。逻辑回归在新的流式数据上取得了最佳结果,准确率达到69.39%,F1分数达到68.97。

英文摘要:

In the context of modern life, particularly in Industry 4.0 within the online space, emotions and moods are frequently conveyed through social media posts. The trend of sharing stories, thoughts, and feelings on these platforms generates a vast and promising data source for Big Data. This creates both a challenge and an opportunity for research in applying technology to develop more automated and accurate methods for detecting stress in social media users. In this study, we developed a real-time system for stress detection in online posts, using the "Dreaddit: A Reddit Dataset for Stress Analysis in Social Media," which comprises 187,444 posts across five different Reddit domains. Each domain contains texts with both stressful and non-stressful content, showcasing various expressions of stress. A labeled dataset of 3,553 lines was created for training. Apache Kafka, PySpark, and AirFlow were utilized to build and deploy the model. Logistic Regression yielded the best results for new streaming data, achieving 69,39% for measuring accuracy and 68,97 for measuring F1-scores.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑