大语言模型时代的创造力支持:一项涉及新锐作家的实证研究
Creativity Support in the Age of Large Language Models: An Empirical Study Involving Emerging Writers
AI总结:
该研究通过30名专业作家参与的实证实验,探究大语言模型在创意写作中的辅助作用,发现其在转译和审阅环节更具效用,为相关研究指明了方向。
摘要:
能够遵循指令并参与对话交互的大语言模型(LLMs)的发展,引发了人们对其在各类支持工具中应用的日益增长的兴趣。我们通过一项有30名参与者的实证用户研究,探究了现代LLMs在辅助专业作家方面的效用。我们的协作写作界面的设计以写作的认知过程模型为基础,该模型将写作视为一个以目标为导向的思维过程,包含非线性认知活动:规划、转译和审阅。参与者被要求提交一份完成后的调查问卷,就LLMs作为写作协作者的潜力与缺陷提供反馈。通过分析作家与LLM的交互,我们发现尽管作家在所有三类认知活动中都会寻求LLM的帮助,但他们认为LLM在转译和审阅方面更有帮助。我们从交互分析和调查问卷回复中得出的发现,指明了利用LLMs进行创意写作辅助的未来研究方向。
英文摘要:
The development of large language models (LLMs) capable of following instructions and engaging in conversational interactions sparked increased interest in their utilization across various support tools. We investigate the utility of modern LLMs in assisting professional writers via an empirical user study (n=30). The design of our collaborative writing interface is grounded in the cognitive process model of writing that views writing as a goal-oriented thinking process encompassing non-linear cognitive activities: planning, translating, and reviewing. Participants are asked to submit a post-completion survey to provide feedback on the potential and pitfalls of LLMs as writing collaborators. Upon analyzing the writer-LLM interactions, we find that while writers seek LLM's help across all three types of cognitive activities, they find LLMs more helpful in translation and reviewing. Our findings from analyzing both the interactions and the survey responses highlight future research directions in creative writing assistance using LLMs.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。