GPT-WritingPrompts数据集:短篇小说中人物刻画的比较分析
The GPT-WritingPrompts Dataset: A Comparative Analysis of Character Portrayal in Short Stories
AI总结:
为理解AI生成故事与人类故事的差异,该研究用GPT-3.5生成的故事扩充Reddit WritingPrompts数据集,从六个维度比较两者情感与描述特征,发现所有维度均存在显著差异且在叙事视角和主角性别分组下有相似偏见,并公开了数据集和代码。
摘要:
大型语言模型生成能力的提升使其成为创意写作和故事叙述的强大工具。因此,定量理解生成故事的本质及其与人类故事叙述的差异至关重要。我们使用相同提示,通过GPT-3.5生成的短篇小说扩充了Reddit WritingPrompts数据集。我们从人类和机器两种生成过程出发,沿六个维度量化并比较了故事叙述的情感和描述特征。研究发现,生成的故事在所有六个维度上与人类故事存在显著差异;当按叙事视角和主角性别分组时,人类和机器生成的内容表现出相似的偏见。我们在https://github.com/KristinHuangg/gpt-writing-prompts发布了数据集和代码。
英文摘要:
The improved generative capabilities of large language models have made them a powerful tool for creative writing and storytelling. It is therefore important to quantitatively understand the nature of generated stories, and how they differ from human storytelling. We augment the Reddit WritingPrompts dataset with short stories generated by GPT-3.5, given the same prompts. We quantify and compare the emotional and descriptive features of storytelling from both generative processes, human and machine, along a set of six dimensions. We find that generated stories differ significantly from human stories along all six dimensions, and that human and machine generations display similar biases when grouped according to the narrative point-of-view and gender of the main protagonist. We release our dataset and code at https://github.com/KristinHuangg/gpt-writing-prompts.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。