伴侣AI与伦理设计：从系统故障与用户需求中学习
Companion AI and Ethical Design: Learning from System Failures and User Desires
查看机构详情
- UNSW Sydney（新南威尔士大学）
- UTS Sydney（悉尼科技大学）
机构由 AI 辅助整理，请以论文原文为准。
浏览论文内容
中文总结 AI 辅助
本研究通过分析Reddit上Replika用户的14,081条评论，发现功能错误损害人机亲密感，提出“亲密AI”概念及情境感知的伦理设计框架。
中文摘要 AI 辅助
人类用户正以对待人类的方式与聊天机器人和伴侣AI技术进行交互。越来越多的AI系统现在被训练用于识别、解释和模拟用户交互中的情感。公平性、问责性、透明性和可解释性（FATE）等伦理考量，在旨在与人类进行社交互动和/或支持关系发展的技术中至关重要。采用语义分析方法，我们考察了Reddit用户讨论论坛中关于Replika（一款领先的伴侣AI应用）的14,081条评论，时间跨度达四年。我们探究用户报告的功能错误能揭示伴侣AI社区中人机亲密关系的哪些信息，以及可以据此制定何种伦理设计框架。研究结果表明，功能错误（即“漏洞”）会给用户带来情感成本，降低亲密感，并凸显了在伴侣AI应用中纳入随机和迭代式亲密形式的更稳健、更具韧性的设计系统的必要性。我们提出用更具包容性的术语“亲密AI”而非“人工亲密”或“伪亲密”来描述这种关系。基于研究结果，我们提供了一个情境感知的、应用型专家系统设计框架，用于编程和设计亲密AI，该框架兼顾用户反馈和伦理AI发展。
英文摘要
Human users are interacting with chatbots and companion AI technologies as if they were human. A growing array of AI-systems are now trained to recognise, interpret and simulate feeling in user interactions. Ethical considerations such as fairness, accountability, transparency and explainability (FATE) are paramount in technologies designed to socially interact with humans and/or support relationship development. Using a semantic approach, we examine 14,081 comments in a Reddit user discussion forum about Replika, a leading companion AI app, across a four-year period. We ask what user-reported functional errors can tell us about human-AI intimacy in companion AI communities, and what ethical design framework can be developed in response. The findings show that functional errors, or ``bugs,'' impose an emotional cost on users, reducing feelings of intimacy and highlighting the need for more robust, resilient design systems that incorporate stochastic and iterative forms of intimacy in companion AI applications. Rather than ``artificial intimacy'' or ``pseudo- intimacy'', we propose the more inclusive term ``Intimate AI'' to describe this relationship. Based on the findings, we offer a contextually aware, applied Expert Systems design framework for the programming and designing of Intimate AI that accounts for user feedback and ethical AI development.
