Fuzzy string matching remains a key issue when political scientists combine data from different sources. Existing matching methods invariably rely on string distances, such as Levenshtein distance and cosine similarity. As such, they are inherently incapable of matching strings that refer to the same entity with different names such as ''JP Morgan'' and ''Chase Bank'', ''DPRK'' and ''North Korea'', ''Chuck Fleischmann (R)'' and ''Charles Fleischmann (R)''. In this letter, we propose to use large language models to entirely sidestep this problem in an easy and intuitive manner. Extensive experiments show that our proposed methods can improve the state of the art by as much as 39% in terms of average precision while being substantially easier and more intuitive to use by political scientists. Moreover, our results are robust against various temperatures. We further note that enhanced prompting can lead to additional performance improvements.
Unraveling Media Perspectives: A Comprehensive Methodology Combining Large Language Models, Topic Modeling, Sentiment Analysis, and Ontology Learning to Analyse Media Bias
Institute of IT Management and Digitization Research (IFID)(信息管理与数字化研究学院)
Leveraging Codebook Knowledge with NLI and ChatGPT for Zero-Shot Political Relation Classification
Georgia Institute of Technology(佐治亚理工学院);The University of Texas at Dallas(德克萨斯大学达拉斯分校);The University of Arizona(亚利桑那大学);West Virginia University(西弗吉尼亚大学)