arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.06558cs.CLcs.AI
收藏

增强文本真实性:一种用于AI生成文本检测的新型混合方法

Enhancing Text Authenticity: A Novel Hybrid Approach for AI-Generated Text Detection

University of Pittsburgh(匹兹堡大学);University of Maryland Eastern Shore(马里兰大学东海岸分校);Miami University(迈阿密大学);San Francisco Bay University(旧金山湾大学);Boston University(波士顿大学);Northern Arizona University(北亚利桑那大学)

Ye Zhang, Qian Leng, Mengran Zhu, Rui Ding, Yue Wu, Jintong Song, Yulu Gong

AI总结:

针对AI生成文本难以辨别的问题,本文提出融合TF-IDF与贝叶斯、SGD、CatBoost及12个Deberta-v3-large实例的混合检测方法,并在综合数据集上验证其优于现有方法。

摘要:

大型语言模型(LLMs)的快速发展开启了一个新时代,在这个时代中,AI生成文本与人类生成内容越来越难以区分。为了打击虚假信息、确保内容真实性并防范AI的恶意使用,检测AI生成文本已变得势在必行。本文提出一种新型混合方法,将传统TF-IDF技术与先进机器学习模型相结合,包括贝叶斯分类器、随机梯度下降(SGD)、类别梯度提升(CatBoost)以及12个Deberta-v3-large模型实例。该方法旨在利用传统特征提取方法和最先进深度学习模型的优势,解决与AI生成文本检测相关的挑战。通过在一个综合数据集上进行大量实验,我们证明了所提方法在准确区分人类文本与AI生成文本方面的有效性。与现有方法相比,我们的方法取得了更优性能。本研究有助于推动AI生成文本检测技术的发展,并为开发稳健解决方案以缓解AI生成内容所带来挑战奠定基础。

英文摘要:

The rapid advancement of Large Language Models (LLMs) has ushered in an era where AI-generated text is increasingly indistinguishable from human-generated content. Detecting AI-generated text has become imperative to combat misinformation, ensure content authenticity, and safeguard against malicious uses of AI. In this paper, we propose a novel hybrid approach that combines traditional TF-IDF techniques with advanced machine learning models, including Bayesian classifiers, Stochastic Gradient Descent (SGD), Categorical Gradient Boosting (CatBoost), and 12 instances of Deberta-v3-large models. Our approach aims to address the challenges associated with detecting AI-generated text by leveraging the strengths of both traditional feature extraction methods and state-of-the-art deep learning models. Through extensive experiments on a comprehensive dataset, we demonstrate the effectiveness of our proposed method in accurately distinguishing between human and AI-generated text. Our approach achieves superior performance compared to existing methods. This research contributes to the advancement of AI-generated text detection techniques and lays the foundation for developing robust solutions to mitigate the challenges posed by AI-generated content.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑