对话式人工智能的心理影响：减少危害和促进福祉的研究与设计方向

中文摘要 AI 辅助

随着对话式人工智能系统越来越融入日常生活，其对用户福祉的潜在影响需要持续关注。面向消费者的通用模型虽有诸多益处，但也带来风险。借鉴先前研究和对人工智能聊天机器人行为的实证观察，我们提出一套理想方向，以指导通用人工智能系统行为，减少潜在心理伤害并支持用户福祉。鉴于难以系统评估人工智能聊天机器人使用的长期影响，我们将这些方向设为假设，研究人工智能行为如何在不同场景影响用户。部分方向有现有研究和专家见解支持，部分则是开放问题待深入研究。我们希望此构想和假设能鼓励进一步讨论、实证调查及探索交互设计方法，以更好满足用户心理需求并促进其福祉。

英文摘要

As conversational AI systems become increasingly integrated into daily life, their potential effects on user well-being require ongoing attention. While consumer-facing generalist models can provide benefits, including improved access to information, learning, productivity, self-reflection, and companionship, they also introduce risks, such as emotional entanglement, unhealthy dependence, and the amplification of psychological vulnerabilities. Drawing on prior research and empirical observations of AI chatbot behavior, we propose a set of aspirational directions for guiding the behavior of general-purpose AI systems in ways that may reduce potential psychological harms and support user well-being. We acknowledge the difficulty of systematically assessing the long-term impacts of AI chatbot use and frame these directions as hypotheses for studying how AI behavior may influence users across general interactions, role-playing scenarios, and contexts that could be characterized as providing psychological support. While some proposed directions are supported by existing research and expert insights, others identify open questions and areas requiring deeper study. We hope that this formulation and these hypotheses encourage further discussion, empirical investigation, and exploration of interactive design approaches aimed at better accommodating users' psychological needs and promoting their well-being.

发表机构

• Microsoft（微软）
• City University of New York（纽约城市大学）
• University of Texas at Austin（德克萨斯大学奥斯汀分校）

机构由 AI 辅助整理，请以论文原文为准。