arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2310.12902cs.CLcs.AI
收藏

实验性叙事:人类众包故事创作与AI故事创作的比较

Experimental Narratives: A Comparison of Human Crowdsourced Storytelling and AI Storytelling

University of California, Berkeley(加州大学伯克利分校)

Nina Begus

AI总结:

本研究提出结合行为与计算实验的框架,对比人类众包故事与GPT-3.5、GPT-4生成的故事,发现二者均体现皮格马利翁神话,AI叙事性别观念更进步但想象力弱于人类,为研究集体想象与社会偏见提供新工具。

摘要:

本文提出了一个结合行为实验与计算实验的框架,采用虚构提示作为一种新型工具,用于研究人类和生成式AI在故事创作中的文化产物与社会偏见。该研究融合叙事学与推论统计学方法,分析了2019年6月众包工作者创作的250个故事,以及2023年3月由GPT-3.5和GPT-4生成的80个故事。众包工作者和大语言模型均回应了关于创造人造人并与之相爱的相同提示。所提出的实验范式可对人类与大语言模型生成的故事进行直接、受控的比较。对这类皮格马利翁式提示的回应证实,皮格马利翁神话在人类与大语言模型的集体想象中均普遍存在。所有征集到的叙事都包含一项科学或技术探索。分析显示,GPT-3.5、尤其是GPT-4生成的叙事,在性别角色与性观念方面比人类创作的叙事更具进步性。尽管采用默认设置且无额外提示的AI叙事偶尔能呈现创新的情节转折,但它们提供的场景和修辞不如人类创作的文本富有想象力。该框架提出,虚构作品可作为洞察人类与基于AI的集体想象及社会维度的窗口。

英文摘要:

The paper proposes a framework that combines behavioral and computational experiments employing fictional prompts as a novel tool for investigating cultural artifacts and social biases in storytelling both by humans and generative AI. The study analyzes 250 stories authored by crowdworkers in June 2019 and 80 stories generated by GPT-3.5 and GPT-4 in March 2023 by merging methods from narratology and inferential statistics. Both crowdworkers and large language models responded to identical prompts about creating and falling in love with an artificial human. The proposed experimental paradigm allows a direct and controlled comparison between human and LLM-generated storytelling. Responses to the Pygmalionesque prompts confirm the pervasive presence of the Pygmalion myth in the collective imaginary of both humans and large language models. All solicited narratives present a scientific or technological pursuit. The analysis reveals that narratives from GPT-3.5 and particularly GPT-4 are more progressive in terms of gender roles and sexuality than those written by humans. While AI narratives with default settings and no additional prompting can occasionally provide innovative plot twists, they offer less imaginative scenarios and rhetoric than human-authored texts. The proposed framework argues that fiction can be used as a window into human and AI-based collective imaginary and social dimensions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑