DAMAGE:检测经对抗性修改的AI生成文本
DAMAGE: Detecting Adversarially Modified AI Generated Text
AI总结:
针对AI人性化工具规避文本检测的问题,本文评估19种工具,提出以数据为中心的增强检测模型,并通过自攻击验证其跨工具泛化与稳健性。
摘要:
AI人性化工具是一类新型在线软件工具,旨在改写和重写AI生成文本,使其能够规避AI检测软件。我们研究了19种AI人性化和改写工具,并定性评估了它们的效果以及在保留原文含义方面的忠实度。我们表明,许多现有AI检测器无法检测经过人性化处理的文本。最后,我们展示了一个稳健模型,该模型采用以数据为中心的增强方法,能够在保持较低误报率的同时检测经过人性化处理的AI文本。我们攻击自己的检测器,训练了一个根据检测器预测进行优化的自有微调模型,并表明我们的检测器在不同人性化工具之间的泛化能力足以对此类攻击保持稳健。
英文摘要:
AI humanizers are a new class of online software tools meant to paraphrase and rewrite AI-generated text in a way that allows them to evade AI detection software. We study 19 AI humanizer and paraphrasing tools and qualitatively assess their effects and faithfulness in preserving the meaning of the original text. We show that many existing AI detectors fail to detect humanized text. Finally, we demonstrate a robust model that can detect humanized AI text while maintaining a low false positive rate using a data-centric augmentation approach. We attack our own detector, training our own fine-tuned model optimized against our detector's predictions, and show that our detector's cross-humanizer generalization is sufficient to remain robust to this attack.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。