arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.10697cs.CY
收藏

LLM作为信息战士?审计基于LLM的聊天机器人如何应对有关俄罗斯对乌克兰战争的虚假信息

LLMs as information warriors? Auditing how LLM-powered chatbots tackle disinformation about Russia's war in Ukraine

Mykola Makhortykh, Ani Baghumyan, Victoria Vziatysheva, Maryna Sydorova, Elizaveta Kuznetsova

AI总结:

本文审计Google、Microsoft和Perplexity的LLM聊天机器人对俄乌战争虚假信息的响应,发现其准确性随语言和时间变化,Perplexity多语言改善,而Gemini仅英语改善、低资源语言恶化。

摘要:

大型语言模型(LLM)的兴起对信息战产生了重大影响。通过促进与虚假信息和宣传活动相关内容的生产,LLM可能放大不同类型的信息行动,并误导在线用户。在本研究中,我们实证考察了由Google、Microsoft和Perplexity开发的基于LLM的聊天机器人如何处理有关俄罗斯对乌克兰战争的虚假信息,以及这些聊天机器人就该主题提供准确信息的能力是否会因语言和时间而变化。研究结果表明,尽管部分聊天机器人(Perplexity)在若干语言中的表现随时间显著改善,但其他聊天机器人(Gemini)的表现仅在英语中有所提升,而在低资源语言中出现恶化。

英文摘要:

The rise of large language models (LLMs) has a significant impact on information warfare. By facilitating the production of content related to disinformation and propaganda campaigns, LLMs can amplify different types of information operations and mislead online users. In our study, we empirically investigate how LLM-powered chatbots, developed by Google, Microsoft, and Perplexity, handle disinformation about Russia's war in Ukraine and whether the chatbots' ability to provide accurate information on the topic varies across languages and over time. Our findings indicate that while for some chatbots (Perplexity), there is a significant improvement in performance over time in several languages, for others (Gemini), the performance improves only in English but deteriorates in low-resource languages.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑