人工智能大猎巫:审稿人对研究写作中生成式人工智能的认知与误解
The Great AI Witch Hunt: Reviewers Perception and (Mis)Conception of Generative AI in Research Writing
AI总结:
本文通过调查17位顶级HCI会议审稿人,发现AI增强写作虽提升可读性但缺乏研究细节与作者反思,审稿人难以区分人机写作,据此倡导基于研究质量而非工具偏见的公正评审指南。
摘要:
生成式人工智能(GenAI)在研究写作中的应用正在快速增长。然而,同行评审者如何识别或误判经过人工智能增强的稿件仍不清楚。为探究人工智能增强写作对同行评审的影响,我们对来自顶级人机交互(HCI)会议的17位同行评审者进行了一项基于片段(snippet)的在线调查。我们的研究结果表明,尽管人工智能增强写作提高了可读性、语言多样性和信息量,但它往往缺乏研究细节和作者的反思维度。评审者始终难以区分人类写作与人工智能增强写作,但他们的判断保持了一致性。他们注意到人工智能增强写作中“人情味”和主观表达的缺失。基于这些发现,我们倡导制定评审者指南,以促进对投稿的公正评价,无论评审者对生成式人工智能是否存在个人偏见。研究本身的质量应始终是评审中的优先事项,而不应受到对所用工具的任何先入之见的影响。我们强调,即使在使用生成式人工智能辅助时,研究者也必须保持对写作过程的作者身份和控制权。
英文摘要:
Generative AI (GenAI) use in research writing is growing fast. However, it is unclear how peer reviewers recognize or misjudge AI-augmented manuscripts. To investigate the impact of AI-augmented writing on peer reviews, we conducted a snippet-based online survey with 17 peer reviewers from top-tier HCI conferences. Our findings indicate that while AI-augmented writing improves readability, language diversity, and informativeness, it often lacks research details and reflective insights from authors. Reviewers consistently struggled to distinguish between human and AI-augmented writing but their judgements remained consistent. They noted the loss of a "human touch" and subjective expressions in AI-augmented writing. Based on our findings, we advocate for reviewer guidelines that promote impartial evaluations of submissions, regardless of any personal biases towards GenAI. The quality of the research itself should remain a priority in reviews, regardless of any preconceived notions about the tools used to create it. We emphasize that researchers must maintain their authorship and control over the writing process, even when using GenAI's assistance.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。