Automating scientific research is considered the final frontier of science. Recently, several papers claim autonomous research agents can generate novel research ideas. Amidst the prevailing optimism, we document a critical concern: a considerable fraction of such research documents are smartly plagiarized. Unlike past efforts where experts evaluate the novelty and feasibility of research ideas, we request $13$ experts to operate under a different situational logic: to identify similarities between LLM-generated research documents and existing work. Concerningly, the experts identify $24\%$ of the $50$ evaluated research documents to be either paraphrased (with one-to-one methodological mapping), or significantly borrowed from existing work. These reported instances are cross-verified by authors of the source papers. The remaining $76\%$ of documents show varying degrees of similarity with existing work, with only a small fraction appearing completely novel. Problematically, these LLM-generated research documents do not acknowledge original sources, and bypass inbuilt plagiarism detectors. Lastly, through controlled experiments we show that automated plagiarism detectors are inadequate at catching plagiarized ideas from such systems. We recommend a careful assessment of LLM-generated research, and discuss the implications of our findings on academic publishing.
Overview of PAN 2026: Voight-Kampff Generative AI Detection, Text Watermarking, Multi-Author Writing Style Analysis, Generative Plagiarism Detection, and Reasoning Trajectory Detection
Friedrich Schiller University Jena(耶纳弗里德里希·施勒格尔大学);University of Applied Sciences BFI(应用科学大学BFI);Mohamed bin Zayed University of Artificial Intelligence(马尔代夫 bin Zayed 人工智能大学);University of Kassel(卡塞尔大学);INSAIT, Sofia University ``St. Kliment Ohridski''(INSAIT,索菲亚大学『圣克莱门特·奥赫里迪斯』);University of Innsbruck(因斯布鲁克大学)
PAN 2026旨在通过客观评估推进计算风格学和文本取证,涵盖生成式AI检测、文本水印、多作者写作分析、抄袭检测及推理轨迹检测等五个新旧任务。
Who Wrote This? Identifying Machine vs Human-Generated Text in Hausa
Kalinga University(卡林加大学);Bayero University(巴耶罗大学);Arewa Data Science Academy(阿雷瓦数据科学学院);DSFSI, University of Pretoria(比勒陀利亚大学 DSFSI);Northeastern University(东北大学);Imperial College London(伦敦帝国学院)
Discourse Features Enhance Detection of Document-Level Machine-Generated Content
Department of Computing Imperial College London London, UK;Chair of Health Informatics Technical University of Munich Munich, Germany;5cm Department of Computing \& Chair of Health Informatics 5cm Imperial College London \& Technical University of Munich 5cm London, UK \& Munich, Germany 5cm
Unveiling Large Language Models Generated Texts: A Multi-Level Fine-Grained Detection Framework
School of Information, Renmin University of China(中国人民大学信息学院);Institute for Advanced Algorithms Research, Shanghai(上海高级算法研究院);School of Information Technology and Management, University of International Business and Economics(对外经济贸易大学信息技术与管理学院);Shanghai University of Finance and Economics(上海财经大学)
Your Language Model Can Secretly Write Like Humans: Contrastive Paraphrase Attacks on LLM-Generated Text Detectors
Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院,清华大学);Harbin Institute of Technology(哈尔滨工业大学);Pengcheng Laboratory(鹏城实验室)
DetectLLM: Leveraging Log Rank Information for Zero-Shot Detection of Machine-Generated Text
Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);Monash University(莫纳什大学);CSIRO’s Data61(澳大利亚联邦科学与工业研究组织Data61研究所);King Abdullah University of Science and Technology(阿卜杜拉国王科技大学)
Large Language Models can be Guided to Evade AI-Generated Text Detection
Southern University of Science and Technology(南方科技大学);Hong Kong University of Science and Technology(香港科技大学);Agency for Science, Technology and Research (A*STAR)(新加坡科技研究局);Nanyang Technological University (NTU)(南洋理工大学)
University of Applied Sciences HTW Berlin(柏林应用技术大学);Riga Technical University(里加技术大学);Uppsala University(乌普萨拉大学);Masaryk University(马萨里克大学);Universidad de Monterrey(蒙特雷大学);Queen Mary University of London(伦敦玛丽女王大学);University of Leeds(利兹大学)
On the Generalization and Adaptation Ability of Machine-Generated Text Detectors in Academic Writing
The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州));Southern University of Science and Technology(南方科技大学);National University of Singapore (Chongqing Research Institute)(新加坡国立大学(重庆研究机构));Fudan University(复旦大学);Qilu University of Technology(齐鲁大学);CISPA Helmholtz Center for Information Security(CISPA 欧洲信息安全研究所)
Stylometry Analysis of Human and Machine Text for Academic Integrity
University of Jeddah(约旦大学);University of Engineering and Technology(工程大学);Munster Technological University(穆斯廷技术大学);King Abdulaziz University(阿卜杜勒阿齐兹大学)