面向NLPCC 2026共享任务6的EVIL-Detect:大语言模型生成文本检测
EVIL-Detect for NLPCC 2026 Shared Task 6: LLM-Generated Text Detection
浏览论文内容
中文总结 AI 辅助
针对中文场景下LLM生成文本检测需求,提出带冲突感知融合的多信号集成框架EVIL-Detect,整合多类信号并校准决策边界,在NLPCC 2026共享任务6中获宏F1 0.8888且排名第一。
中文摘要 AI 辅助
大语言模型(LLM)的快速发展提升了可靠检测LLM生成文本的需求,尤其在包含人类撰写文本(HWT)、LLM生成文本(LGT)和LLM优化文本(HLT)的真实中文场景中。本文提出面向NLPCC 2026共享任务6的EVIL-Detect,这是一种带冲突感知融合的多信号集成框架,整合了编辑程度回归、零样本似然对比信号、词汇统计及保守文本规则。通过校准决策边界与冲突感知集成,该系统提升了强分布外偏移下的鲁棒性,取得0.8888的宏F1值并在官方评估中排名第一,代码可在指定URL获取。
英文摘要
The rapid development of large language models (LLMs) has increased the need for reliable detection of LLM-generated text, especially in realistic Chinese scenarios involving human-written text (HWT), LLM-generated text (LGT), and LLM-refined text (HLT). This paper presents EVIL-Detect, a multi-signal ensemble framework with conflict-aware fusion for NLPCC 2026 Shared Task 6. The system integrates edit-extent regression, zero-shot likelihood-contrast signals, lexical statistics, and conservative text rules. With calibrated decision boundaries and conflict-aware integration, our system improves robustness under strong out-of-distribution shifts, achieving a macro-F1 score of 0.8888 and ranking first in the official evaluation. Our code is available at https://github.com/bbbbhrrrr/evildetect.
发表机构
- Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所)
- School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院)
机构由 AI 辅助整理,请以论文原文为准。