arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.09339cs.CL
收藏

理解AI聊天机器人使用中的风险与依赖性:从用户话语出发

Understanding Risk and Dependency in AI Chatbot Use from User Discourse

Kent State University(肯特州立大学)

Jianfeng Zhu, Karin G. Coifman, Ruoming Jin

AI总结:

本研究通过分析用户话语揭示AI聊天机器人使用中的心理风险维度,发现自我调节困难和对自主性、控制和技术风险的恐惧为主要特征。

摘要:

生成式AI系统正日益融入日常生活,但关于与AI使用相关的心理风险如何产生、体验和被用户调节的实证理解仍然有限。我们对2023至2025年间从两个Reddit社区r/AIDangers和r/ChatbotAddiction收集的帖子进行了大规模计算主题分析,专门关注与AI相关的伤害和痛苦。使用基于Braun和Clarke反思框架的多代理、LLM辅助主题分析方法,我们识别出14个反复出现的主题类别,并将其综合为五个更高阶的体验维度。为进一步刻画情感模式,我们应用基于BERT的分类器进行情感标注,并在不同维度上可视化情感档案。我们的发现揭示了五个基于现实用户话语的AI相关心理风险经验维度,其中自我调节困难最为普遍,恐惧集中在对自主性、控制和技术风险的担忧中。这些结果提供了来自真实用户经验的早期实证证据,展示了AI安全如何在非实验室或推测性背景下被感知和情感体验,为未来AI安全研究、评估和负责任的治理提供了基础。

英文摘要:

Generative AI systems are increasingly embedded in everyday life, yet empirical understanding of how psychological risk associated with AI use emerges, is experienced, and is regulated by users remains limited. We present a large-scale computational thematic analysis of posts collected between 2023 and 2025 from two Reddit communities, r/AIDangers and r/ChatbotAddiction, explicitly focused on AI-related harm and distress. Using a multi-agent, LLM-assisted thematic analysis grounded in Braun and Clarke's reflexive framework, we identify 14 recurring thematic categories and synthesize them into five higher-order experiential dimensions. To further characterize affective patterns, we apply emotion labeling using a BERT-based classifier and visualize emotional profiles across dimensions. Our findings reveal five empirically derived experiential dimensions of AI-related psychological risk grounded in real-world user discourse, with self-regulation difficulties emerging as the most prevalent and fear concentrated in concerns related to autonomy, control, and technical risk. These results provide early empirical evidence from lived user experience of how AI safety is perceived and emotionally experienced outside laboratory or speculative contexts, offering a foundation for future AI safety research, evaluation, and responsible governance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑