arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2312.03746cs.CLcs.AIcs.LG

从文学视角评估大型语言模型的创造力

Evaluating Large Language Model Creativity from a Literary Perspective

Imperial College London(帝国理工学院);Google DeepMind(谷歌DeepMind);Institute of Historical Research, School of Advanced Study, University of London(伦敦大学高级研究院历史研究所);University of Southampton(南安普顿大学)

Murray Shanahan, Catherine Clarke

AI总结:

本文通过深度案例研究,提出交互式多声部提示策略,并结合文学批评与计算创造力视角,评估 LLM 辅助创意写作的潜力,证明输出质量与提示精巧程度相呼应。

摘要:

本文通过一项单一而深入的案例研究,评估大型语言模型(LLM)作为创意写作过程辅助工具的潜力。在研究过程中,我们开发了交互式、多声部的提示策略,将背景描述(场景设置、情节元素)、指导写作的指令、目标风格的文本样本,以及对给定样本的批评性讨论交织在一起。我们从文学批评视角以及计算创造力(人工智能的一个子领域)的立场,对结果进行定性评估。我们的发现支持这样一种观点:使用 LLM 所能获得结果的精妙程度,反映了提示本身的精妙程度。

英文摘要:

This paper assesses the potential for large language models (LLMs) to serve as assistive tools in the creative writing process, by means of a single, in-depth case study. In the course of the study, we develop interactive and multi-voice prompting strategies that interleave background descriptions (scene setting, plot elements), instructions that guide composition, samples of text in the target style, and critical discussion of the given samples. We qualitatively evaluate the results from a literary critical perspective, as well as from the standpoint of computational creativity (a sub-field of artificial intelligence). Our findings lend support to the view that the sophistication of the results that can be achieved with an LLM mirrors the sophistication of the prompting.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑