arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.10461cs.HC
收藏

探索亲子对生成式AI安全性的认知:担忧、缓解策略与设计启示

Exploring Parent-Child Perceptions on Safety in Generative AI: Concerns, Mitigation Strategies, and Design Implications

Yaman Yu, Tanusree Sharma, Melinda Hu, Justin Wang, Yang Wang

AI总结:

本研究通过Reddit内容分析与20名亲子访谈,发现亲子对生成式AI(GAI)的使用场景与风险认知存在差异,家长因平台缺乏管控功能难以有效监管,最终提出优化GAI安全与亲子沟通的设计建议。

摘要:

生成式人工智能(GAI)在青少年中的广泛使用已引发严重的滥用问题与安全担忧。为识别风险并理解家长管控的挑战,我们对Reddit平台内容进行了分析,并访谈了20名参与者(7名青少年和13名家长)。研究发现,家长对孩子使用GAI的广泛方式存在明显认知缺口,例如孩子会与角色类聊天机器人互动以获得情感支持,或开展虚拟关系。家长与孩子对GAI相关风险的认知存在差异:家长主要担忧数据收集、错误信息以及接触不当内容;相比之下,青少年更担心沉迷于与GAI的虚拟关系、GAI被滥用于在社交群体中传播有害内容,以及个人数据在GAI应用中被未经授权使用导致的隐私侵犯。GAI平台缺乏家长控制功能,迫使家长依赖系统自带管控措施、手动查看历史记录、共享账号以及开展主动调解。尽管采取了这些措施,家长仍难以全面掌握GAI相关的各类风险,也无法开展有效的实时监控、调解与教育。我们提出了设计建议,以改善亲子沟通并提升GAI使用的安全性。

英文摘要:

The widespread use of Generative Artificial Intelligence (GAI) among teenagers has led to significant misuse and safety concerns. To identify risks and understand parental controls challenges, we conducted a content analysis on Reddit and interviewed 20 participants (seven teenagers and 13 parents). Our study reveals a significant gap in parental awareness of the extensive ways children use GAI, such as interacting with character-based chatbots for emotional support or engaging in virtual relationships. Parents and children report differing perceptions of risks associated with GAI. Parents primarily express concerns about data collection, misinformation, and exposure to inappropriate content. In contrast, teenagers are more concerned about becoming addicted to virtual relationships with GAI, the potential misuse of GAI to spread harmful content in social groups, and the invasion of privacy due to unauthorized use of their personal data in GAI applications. The absence of parental control features on GAI platforms forces parents to rely on system-built controls, manually check histories, share accounts, and engage in active mediation. Despite these efforts, parents struggle to grasp the full spectrum of GAI-related risks and to perform effective real-time monitoring, mediation, and education. We provide design recommendations to improve parent-child communication and enhance the safety of GAI use.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑