arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2504.16913cs.CLcs.AI

追踪思维:利用链式思维推理识别AI生成文本背后的LLM

Tracing Thought: Using Chain-of-Thought Reasoning to Identify the LLM Behind AI-Generated Text

Department of Computer Science and Engineering(计算机科学与工程系);Indian Institute of Technology Guwahati(印度理工学院瓜哇蒂)

Shifali Agrahari, Sanasam Ranbir Singh

AI总结:

本文提出COT Fine-tuned框架,利用链式思维推理进行双任务检测,既能区分AI生成与人类文本,又能识别生成文本的具体LLM,实验证明其高准确率和可解释性。

摘要:

近年来,由于对学术诚信、错误信息和道德AI部署的担忧,AI生成文本的检测已成为一个关键研究领域。本文提出了COT Fine-tuned,一种用于检测AI生成文本并识别生成该文本的特定语言模型的新框架。我们提出了一种双任务方法,其中任务A涉及将文本分类为AI生成或人类撰写,任务B识别文本背后的特定LLM。我们方法的关键创新在于使用链式思维推理,这使得模型能够为其预测生成解释,从而增强透明度和可解释性。我们的实验表明,COT Fine-tuned在两项任务中均实现了高准确率,在LLM识别和人类-AI分类方面表现出强劲性能。我们还表明,CoT推理过程对模型的有效性和可解释性有显著贡献。

英文摘要:

In recent years, the detection of AI-generated text has become a critical area of research due to concerns about academic integrity, misinformation, and ethical AI deployment. This paper presents COT Fine-tuned, a novel framework for detecting AI-generated text and identifying the specific language model. responsible for generating the text. We propose a dual-task approach, where Task A involves classifying text as AI-generated or human-written, and Task B identifies the specific LLM behind the text. The key innovation of our method lies in the use of Chain-of-Thought reasoning, which enables the model to generate explanations for its predictions, enhancing transparency and interpretability. Our experiments demonstrate that COT Fine-tuned achieves high accuracy in both tasks, with strong performance in LLM identification and human-AI classification. We also show that the CoT reasoning process contributes significantly to the models effectiveness and interpretability.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑