The rise of large language models (LLMs) has a significant impact on information warfare. By facilitating the production of content related to disinformation and propaganda campaigns, LLMs can amplify different types of information operations and mislead online users. In our study, we empirically investigate how LLM-powered chatbots, developed by Google, Microsoft, and Perplexity, handle disinformation about Russia's war in Ukraine and whether the chatbots' ability to provide accurate information on the topic varies across languages and over time. Our findings indicate that while for some chatbots (Perplexity), there is a significant improvement in performance over time in several languages, for others (Gemini), the performance improves only in English but deteriorates in low-resource languages.
Evolution of wartime discourse on Telegram: A comparative study of Ukrainian and Russian policymakers' communication before and after Russia's full-scale invasion of Ukraine
University of Bern(伯尔尼大学);University of Vienna(维也纳大学)
Friend or Foe? Language as an ideological switch in open-weight LLMs under Russian disinformation stress
Institute of Culture Studies, University of Silesia in Katowice(文化研究学院,卡托维察大学);University of Texas at Austin(德克萨斯大学奥斯汀分校);National Aviation University(国家航空大学)
Crisis-induced differences in attention towards Ukraine in Twitter 2008-2023
Tallinn University(塔林大学);Estonian Literary Museum(爱沙尼亚文学博物馆);Baltic Film, Media and Arts School, Tallinn University(塔林大学波罗的海电影、媒体与艺术学院);Vermont Complex Systems Institute(佛蒙特复杂系统研究所);University of Vermont(佛蒙特大学);Santa Fe Institute(圣塔菲研究所);Complexity Science Hub(复杂性科学中心)