发表机构
Nha Trang University; Ho Chi Minh City University of Technology and Engineering(芽庄大学; 胡志明市技术与工程大学)
机构由 AI 辅助整理,请以论文原文为准。AI 中文总结
本研究提出开源越南语AI生成文本零样本检测器VietAIDetector,基于越南语专用语言模型,在域外数据集上性能优于英语现有方法,可通过Gradio网页界面交互,支持多类输入并输出检测结果。
AI 中文摘要
近年来,区分AI生成文本与人类撰写文本仍是一项挑战。本文介绍了VietAIDetector,一款专门用于检测越南语AI生成文本的开源工具。它允许用户通过Gradio网页界面进行交互,输入内容涵盖原始越南语文本、常见文本文件格式,包括扫描文档以及超出所用大型语言模型(LLM)上下文窗口的超长文本。该工具的核心组件采用零样本(Zero-Shot)方法检测AI生成文本,无需特定领域训练数据,基于此前的VietBinoculars和Binoculars研究构建。该工具构建于越南语专用语言模型之上,并在域外数据集上进行了评估,与主要针对英语开发的现有方法相比展现出更优性能。此外,用户可根据F1分数、准确率或TPR@0.05FPR要求选择最优检测阈值。结果通过网页界面呈现,用户可轻松查看和验证可疑文本,或将其下载为PDF报告。该工具可通过此公开链接获取。
英文摘要
In recent years, distinguishing between AI-generated text and human-written text has remained a challenge. In this paper, we introduce VietAIDetector, an open-source tool designed specifically for detecting Vietnamese AI-generated text. It allows users to interact through a Gradio web interface with inputs ranging from raw Vietnamese text to common text file formats, including scanned documents and exceptionally long texts that exceed the context size of the employed Large Language Models (LLMs). The core component of the tool employs a Zero-Shot approach to detect AI-generated text without requiring domain-specific training data, building upon the previous VietBinoculars and Binoculars research. The tool is built upon a Vietnamese-specific language model and has been evaluated on out-of-domain datasets, demonstrating superior performance compared to existing methods primarily developed for English. Additionally, users can select optimal detection thresholds based on F1 score, accuracy, or TPR@0.05FPR requirements. The results are presented through the web interface, allowing users to easily review and verify suspicious texts or download them as a PDF report. The tool is publicly available at https://github.com/trieuntu/VietAIDetector
Comments17 pages, 5 figures