MGTEVAL:一种用于机器生成文本检测器系统性评估的交互平台
MGTEVAL: An Interactive Platform for Systemtic Evaluation of Machine-Generated Text Detectors
AI总结:
MGTEVAL平台通过统一接口构建自定义基准、应用文本攻击测试集、训练检测器并评估性能,解决MGT检测评估碎片化问题。
摘要:
我们介绍了MGTEVAL,一种可扩展的平台,用于系统性评估机器生成文本(MGT)检测器。尽管MGT检测在快速进步,但现有评估往往分散在数据集、预处理、攻击和度量标准上,使结果难以比较和重现。MGTEVAL将工作流程分为四个组成部分:数据集构建、数据集攻击、检测器训练和性能评估。它支持通过可配置的LLMs生成MGT,应用12种文本攻击测试集,通过统一接口训练检测器,并报告有效性、鲁棒性和效率。该平台提供命令行和基于Web的界面,使用户无需重写代码即可进行友好的实验。
英文摘要:
We present MGTEVAL, an extensible platform for systematic evaluation of Machine-Generated Text (MGT) detectors. Despite rapid progress in MGT detection, existing evaluations are often fragmented across datasets, preprocessing, attacks, and metrics, making results hard to compare and reproduce. MGTEVAL organizes the workflow into four components: Dataset Building, Dataset Attack, Detector Training, and Performance Evaluation. It supports constructing custom benchmarks by generating MGT with configurable LLMs, applying 12 text attacks to test sets, training detectors via a unified interface, and reporting effectiveness, robustness, and efficiency. The platform provides both command-line and Web-based interfaces for user-friendly experimentation without code rewriting.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。