arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2410.04545cs.CL

AI辅助的披露如何影响人们对写作的感知?

How Does the Disclosure of AI Assistance Affect the Perceptions of Writing?

Purdue University(普渡大学);University of Connecticut(康涅狄格大学)

Zhuoyan Li, Chen Liang, Jing Peng, Ming Yin

AI总结:

该研究通过实验探究披露写作中AI辅助的程度与类型对人们写作感知的影响,发现披露AI内容生成辅助会降低写作平均质量评分、增加评价差异,且会降低AI辅助作品的高排名占比,个体写作自信与AI熟悉度起调节作用。

摘要:

大语言模型等生成式AI技术的最新进展推动了AI辅助融入写作工作流,催生了写作领域人机协同共创的新范式。为了解人们如何看待在这一范式下产出的写作作品,本文开展了一项实验研究,探究披露写作过程中AI辅助的程度与类型是否、以及如何影响人们对写作的多方面感知,包括他们对写作质量的评价以及对不同作品的排序。研究结果表明,披露写作过程中的AI辅助,尤其是AI在生成新内容方面提供了辅助时,会降低议论文和创意故事的平均质量评分。这种平均质量评分的下降,往往伴随着不同个体对同一篇写作的质量评价差异程度的提升。事实上,个体的写作自信心、对AI写作助手的熟悉度等因素,被证实会调节AI辅助披露对其写作质量评价的影响。我们还发现,披露AI辅助的使用,可能会显著降低由AI内容生成辅助产出的写作作品在高排名作品中的占比。

英文摘要:

Recent advances in generative AI technologies like large language models have boosted the incorporation of AI assistance in writing workflows, leading to the rise of a new paradigm of human-AI co-creation in writing. To understand how people perceive writings that are produced under this paradigm, in this paper, we conduct an experimental study to understand whether and how the disclosure of the level and type of AI assistance in the writing process would affect people's perceptions of the writing on various aspects, including their evaluation on the quality of the writing and their ranking of different writings. Our results suggest that disclosing the AI assistance in the writing process, especially if AI has provided assistance in generating new content, decreases the average quality ratings for both argumentative essays and creative stories. This decrease in the average quality ratings often comes with an increased level of variations in different individuals' quality evaluations of the same writing. Indeed, factors such as an individual's writing confidence and familiarity with AI writing assistants are shown to moderate the impact of AI assistance disclosure on their writing quality evaluations. We also find that disclosing the use of AI assistance may significantly reduce the proportion of writings produced with AI's content generation assistance among the top-ranked writings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑