arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2510.07458cs.CL
收藏

民粹主义遇上人工智能:利用大语言模型推进民粹主义研究

Populism Meets AI: Advancing Populism Research with LLMs

Mount St. Mary’s University(圣玛丽大学);German Institute for Global and Area Studies(全球与区域研究所);Princeton University(普林斯顿大学);University of California, Los Angeles(加州大学洛杉矶分校);University of Oxford(牛津大学);Diego Portales University(迪埃戈·波尔塔尔大学);ELTE Centre for Social Sciences(埃尔泰社会科学中心);Brigham Young University(Brigham Young 大学)

Yujin J. Jung, Eduardo Ryô Tamaki, Julia Chatterley, Grant Mitchell, Semir Dzebo, Cristóbal Sandoval, Levente Littvay, Kirk A. Hawkins

AI总结:

本研究提出一种基于评分标准和锚点引导的思维链提示方法,利用大语言模型复现全球民粹主义数据库的评分过程,使模型在民粹主义分类上达到与专家人类编码员相当的准确度,从而为大规模、跨语言的民粹主义研究提供高效解决方案。

摘要:

衡量民粹主义的观念内容仍然是一个挑战。基于文本分析的传统策略对于构建该领域的基础以及提供有效、客观的民粹主义框架指标至关重要。然而,这些方法成本高昂、耗时,并且难以跨语言、跨情境以及在大规模语料库上进行扩展。在此,我们展示了一种基于评分标准和锚点引导的思维链(CoT)提示方法的结果,该方法模拟了人类编码员的培训过程。通过利用全球民粹主义数据库(GPD)——一个包含全球领导人演讲并按民粹主义程度进行标注的综合性数据集——我们通过向大语言模型(LLM)提供经过改编的相同文档来引导模型的推理,从而复制了培训人类编码员的过程。随后,我们通过复现GPD中的评分,测试了多个专有和开源权重模型。我们的研究结果表明,这种特定领域的提示策略使LLM能够达到与专家人类编码员相当的分类准确度,展示了其驾驭民粹主义中细微、情境敏感方面的能力。

英文摘要:

Measuring the ideational content of populism remains a challenge. Traditional strategies based on textual analysis have been critical for building the field's foundations and providing a valid, objective indicator of populist framing. Yet these approaches are costly, time consuming, and difficult to scale across languages, contexts, and large corpora. Here we present the results from a rubric and anchor guided chain of thought (CoT) prompting approach that mirrors human coder training. By leveraging the Global Populism Database (GPD), a comprehensive dataset of global leaders' speeches annotated for degrees of populism, we replicate the process used to train human coders by prompting the LLM with an adapted version of the same documentation to guide the model's reasoning. We then test multiple proprietary and open weight models by replicating scores in the GPD. Our findings reveal that this domain specific prompting strategy enables the LLM to achieve classification accuracy on par with expert human coders, demonstrating its ability to navigate the nuanced, context sensitive aspects of populism.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑