揭露粉红 slime 纪实:语言特征与对抗 LLM 生成威胁的鲁棒检测
Exposing Pink Slime Journalism: Linguistic Signatures and Robust Detection Against LLM-Generated Threats
AI总结:
本文提出了一种基于语言特征的鲁棒检测框架,以应对LLM生成的粉红 slime 纪实威胁,提升了检测性能27%。
摘要:
当地新闻景观,美国2800万民众可靠信息的重要来源,正面临来自粉红 slime 纪实的日益严重威胁,这是一种低质量、自动生成的文章,模仿合法的本地报道。检测这些欺骗性文章需要对它们的语言、风格和词汇特征进行细致分析。在本研究中,我们进行了全面研究,以揭示粉红 slime 内容的区分模式,并基于这些洞察提出检测策略。除了传统生成方法外,我们强调了一个新的对抗向量:通过大型语言模型(LLMs)进行的修改。我们的发现表明,即使消费者可访问的LLMs也能显著削弱现有检测系统,使性能下降高达40%(F1分数)。为应对这一威胁,我们引入了一个专门设计以抵抗基于LLM的对抗攻击并适应自动粉红 slime 纪实演变景观的鲁棒学习框架,并展示了性能提升高达27%。
英文摘要:
The local news landscape, a vital source of reliable information for 28 million Americans, faces a growing threat from Pink Slime Journalism, a low-quality, auto-generated articles that mimic legitimate local reporting. Detecting these deceptive articles requires a fine-grained analysis of their linguistic, stylistic, and lexical characteristics. In this work, we conduct a comprehensive study to uncover the distinguishing patterns of Pink Slime content and propose detection strategies based on these insights. Beyond traditional generation methods, we highlight a new adversarial vector: modifications through large language models (LLMs). Our findings reveal that even consumer-accessible LLMs can significantly undermine existing detection systems, reducing their performance by up to 40% in F1-score. To counter this threat, we introduce a robust learning framework specifically designed to resist LLM-based adversarial attacks and adapt to the evolving landscape of automated pink slime journalism, and showed and improvement by up to 27%.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。