迈向安全演进:支持青少年心理与性健康知识发现的人工智能(AI)对话代理
Toward Safe Evolution of Artificial Intelligence (AI) based Conversational Agents to Support Adolescent Mental and Sexual Health Knowledge Discovery
AI总结:
本文审视 AI 对话代理支持青少年心理与性健康知识发现的机遇与安全风险,呼吁建立防护栏以推动其安全演进。
摘要:
随着近期各类基于人工智能(AI)的对话代理(CAs)发布,青少年越来越多地使用 CAs 围绕敏感话题进行交互式知识发现,包括心理健康和性健康话题。通过在线搜索探索此类敏感话题一直是青少年发展的重要组成部分,而 CAs 能够通过类人对话支持他们在此类话题上的知识发现。然而,已有研究记录了青少年与基于 AI 的 CAs 互动时出现的意外风险,例如接触不当内容、虚假信息,以及收到损害其心理和身体健康的建议(例如自残建议)。在这篇立场论文中,我们讨论了 CAs 支持青少年心理与性健康知识发现的当前格局与机遇。我们还讨论了在青少年围绕性健康和心理健康话题与 CAs 互动时,确保其安全所面临的一些挑战。我们呼吁开展讨论,探讨如何为面向青少年的基于 AI 的 CAs 的安全演进设置防护栏。
英文摘要:
Following the recent release of various Artificial Intelligence (AI) based Conversation Agents (CAs), adolescents are increasingly using CAs for interactive knowledge discovery on sensitive topics, including mental and sexual health topics. Exploring such sensitive topics through online search has been an essential part of adolescent development, and CAs can support their knowledge discovery on such topics through human-like dialogues. Yet, unintended risks have been documented with adolescents' interactions with AI-based CAs, such as being exposed to inappropriate content, false information, and/or being given advice that is detrimental to their mental and physical well-being (e.g., to self-harm). In this position paper, we discuss the current landscape and opportunities for CAs to support adolescents' mental and sexual health knowledge discovery. We also discuss some of the challenges related to ensuring the safety of adolescents when interacting with CAs regarding sexual and mental health topics. We call for a discourse on how to set guardrails for the safe evolution of AI-based CAs for adolescents.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。