During the last fifteen years, automatic text scaling has become one of the key tools of the Text as Data community in political science. Prominent text scaling algorithms, however, rely on the assumption that latent positions can be captured just by leveraging the information about word frequencies in documents under study. We challenge this traditional view and present a new, semantically aware text scaling algorithm, SemScale, which combines recent developments in the area of computational linguistics with unsupervised graph-based clustering. We conduct an extensive quantitative analysis over a collection of speeches from the European Parliament in five different languages and from two different legislative terms, and show that a scaling approach relying on semantic document representations is often better at capturing known underlying political dimensions than the established frequency-based (i.e., symbolic) scaling method. We further validate our findings through a series of experiments focused on text preprocessing and feature selection, document representation, scaling of party manifestos, and a supervised extension of our algorithm. To catalyze further research on this new branch of text scaling methods, we release a Python implementation of SemScale with all included data sets and evaluation procedures.
Evidence of a log scaling law for political persuasion with large language models
University of Oxford(牛津大学);The Alan Turing Institute(艾伦·图灵研究所);Royal Holloway, University of London(伦敦大学皇家霍洛威学院);Bocconi University(博科尼大学);Meedan(米丹(Meedan))
LLM-Generated Natural Language Meets Scaling Laws: New Explorations and Data Augmentation Methods
School of Information Resource Management, Renmin University of China(中国人民大学信息资源管理学院);School of Computing, National University of Singapore(新加坡国立大学计算机学院)
When LLM Meets Tree Search: A Systematic View of Inference as Search in Large Language Models
Zhejiang University(浙江大学);Fudan University(复旦大学);Shanghai AI Laboratory(上海人工智能实验室);University of British Columbia(不列颠哥伦比亚大学);Stony Brook University(石溪大学);The Chinese University of Hong Kong(香港中文大学)