Populism Meets AI: Advancing Populism Research with LLMs
Mount St. Mary’s University(圣玛丽大学);German Institute for Global and Area Studies(全球与区域研究所);Princeton University(普林斯顿大学);University of California, Los Angeles(加州大学洛杉矶分校);University of Oxford(牛津大学);Diego Portales University(迪埃戈·波尔塔尔大学);ELTE Centre for Social Sciences(埃尔泰社会科学中心);Brigham Young University(Brigham Young 大学)
Yujin J. Jung, Eduardo Ryô Tamaki, Julia Chatterley, Grant Mitchell, Semir Dzebo, Cristóbal Sandoval, Levente Littvay, Kirk A. Hawkins
备注:
27 pages, 3 figures. Preprint version under review
Measuring the ideational content of populism remains a challenge. Traditional strategies based on textual analysis have been critical for building the field's foundations and providing a valid, objective indicator of populist framing. Yet these approaches are costly, time consuming, and difficult to scale across languages, contexts, and large corpora. Here we present the results from a rubric and anchor guided chain of thought (CoT) prompting approach that mirrors human coder training. By leveraging the Global Populism Database (GPD), a comprehensive dataset of global leaders' speeches annotated for degrees of populism, we replicate the process used to train human coders by prompting the LLM with an adapted version of the same documentation to guide the model's reasoning. We then test multiple proprietary and open weight models by replicating scores in the GPD. Our findings reveal that this domain specific prompting strategy enables the LLM to achieve classification accuracy on par with expert human coders, demonstrating its ability to navigate the nuanced, context sensitive aspects of populism.
Reinforcement Learning Meets Large Language Models: A Survey of Advancements and Applications Across the LLM Lifecycle
Fudan University(复旦大学);The Chinese University of Hong Kong, MMLab(香港中文大学MMLab);Lancaster University(兰卡斯特大学);Tongji University(同济大学);The University of Toronto(多伦多大学)
Lean Meets Theoretical Computer Science: Scalable Synthesis of Theorem Proving Challenges in Formal-Informal Pairs
D-CHAB, ETH Zurich, Zurich, Switzerland.;D-INFK, ETH Zurich, Zurich, Switzerland.;ETH AI Center, Zurich, Switzerland.;University of Pennsylvania, PA, USA.;Independent Researcher.
Assessing Socio-Cultural Alignment and Technical Safety of Sovereign LLMs
Graduate School of Data Science, Dept. of Data Science, Seoul National University(数据科学研究生院、数据科学系、首尔国立大学);College of Engineering, Dept. of Computer Science and Engineering, Seoul National University(工程学院、计算机科学与工程系、首尔国立大学)
RephQA: Evaluating Readability of Large Language Models in Public Health Question Answering
Yale University, Department of Computer Science(耶鲁大学计算机科学系);Yale University, School of Nursing(耶鲁大学护理学院);Yale University, School of Public Health(耶鲁大学公共卫生学院);Northeastern University(东北大学)
KokushiMD-10: Benchmark for Evaluating Large Language Models on Ten Japanese National Healthcare Licensing Examinations
Kyoto University(京都大学);The Hong Kong University of Science and Technology(香港科技大学);Xi’an Jiaotong-Liverpool University(西安交通大学利物浦大学);The University of Tokyo(东京大学)