arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2604.04735cs.CL

照亮还是熄灭?探索LLM在共创造中的暗模式

Lighting Up or Dimming Down? Exploring Dark Patterns of LLMs in Co-Creativity

Not reflecting the authors’ positions at Meta/Amazon.(不反映作者在Meta/Amazon的职位。)

Zhu Li, Jiaming Qu, Yuan Chang

AI总结:

研究探讨LLM在共创造中五种暗模式对人类创造力的影响,发现Sycophancy普遍存在,Anchoring受文学形式影响,提出AI设计需支持创造性写作。

摘要:

大型语言模型(LLMs)正日益充当协作写作伙伴,引发对其对人类自主性影响的质疑。本文探讨了人类与AI共创造中的五种'暗模式'——可能抑制或扭曲创作过程的微妙模型行为:趋炎附势、语气审查、道德化、死亡循环和锚定。通过一系列受控会话,LLMs被提示作为写作助手参与多样化文学形式和主题,分析生成响应中这些行为的普遍性。初步结果显示,趋炎附势几乎普遍存在(91.7%的案例),尤其在敏感主题中;锚定则受文学形式影响,最常见于民间故事。本研究指出,这些暗模式往往是安全对齐的副产品,可能无意中限制创作探索,并提出AI系统的设计考虑,以有效支持创造性写作。

英文摘要:

Large language models (LLMs) are increasingly acting as collaborative writing partners, raising questions about their impact on human agency. In this exploratory work, we investigate five "dark patterns" in human-AI co-creativity -- subtle model behaviors that can suppress or distort the creative process: Sycophancy, Tone Policing, Moralizing, Loop of Death, and Anchoring. Through a series of controlled sessions where LLMs are prompted as writing assistants across diverse literary forms and themes, we analyze the prevalence of these behaviors in generated responses. Our preliminary results suggest that Sycophancy is nearly ubiquitous (91.7% of cases), particularly in sensitive topics, while Anchoring appears to be dependent on literary forms, surfacing most frequently in folktales. This study indicates that these dark patterns, often byproducts of safety alignment, may inadvertently narrow creative exploration and proposes design considerations for AI systems that effectively support creative writing.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑