arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2502.16487cs.CL
收藏

闪光的未必都是新的:AI生成研究中的剽窃问题

All That Glitters is Not Novel: Plagiarism in AI Generated Research

Indian Institute of Science(印度科学研究所)

Tarun Gupta, Danish Pruthi

AI总结:

该研究针对AI生成科研文档的剽窃问题,通过专家评估和对照实验,发现大语言模型生成的研究文档存在较高比例的剽窃且难以被现有检测器识别,建议对AI生成研究需谨慎评估。

摘要:

科研自动化被视为科学的终极前沿。近期,多篇论文声称自主研究智能体能够生成新颖的研究想法。在普遍的乐观情绪中,我们记录了一个关键问题:这类研究文档中有相当一部分存在巧妙的剽窃行为。与以往由专家评估研究想法的新颖性和可行性的工作不同,我们邀请13位专家以不同的情境逻辑开展工作:识别大语言模型(LLM)生成的研究文档与现有工作之间的相似性。令人担忧的是,专家发现在50份被评估的研究文档中,有24%要么是改写(存在一对一的方法映射),要么大量借鉴了现有工作。这些被报告的案例已通过源论文作者的交叉验证。剩余76%的文档与现有工作存在不同程度的相似性,只有一小部分看起来完全新颖。问题在于,这些LLM生成的研究文档并未注明原始来源,还能绕过内置的剽窃检测器。最后,通过对照实验我们发现,自动化剽窃检测器不足以捕捉来自这类系统的剽窃想法。我们建议对LLM生成的研究进行仔细评估,并讨论了我们的发现对学术出版的影响。

英文摘要:

Automating scientific research is considered the final frontier of science. Recently, several papers claim autonomous research agents can generate novel research ideas. Amidst the prevailing optimism, we document a critical concern: a considerable fraction of such research documents are smartly plagiarized. Unlike past efforts where experts evaluate the novelty and feasibility of research ideas, we request $13$ experts to operate under a different situational logic: to identify similarities between LLM-generated research documents and existing work. Concerningly, the experts identify $24\%$ of the $50$ evaluated research documents to be either paraphrased (with one-to-one methodological mapping), or significantly borrowed from existing work. These reported instances are cross-verified by authors of the source papers. The remaining $76\%$ of documents show varying degrees of similarity with existing work, with only a small fraction appearing completely novel. Problematically, these LLM-generated research documents do not acknowledge original sources, and bypass inbuilt plagiarism detectors. Lastly, through controlled experiments we show that automated plagiarism detectors are inadequate at catching plagiarized ideas from such systems. We recommend a careful assessment of LLM-generated research, and discuss the implications of our findings on academic publishing.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑