arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.08147cs.CL

LLM-POTUS Score:一种利用大语言模型分析总统辩论的框架

LLM-POTUS Score: A Framework of Analyzing Presidential Debates with Large Language Models

School of Computing, University of Georgia(佐治亚大学计算学院);State University of New York at Albany(纽约州立大学奥尔巴尼分校)

Zhengliang Liu, Yiwei Li, Oleksandra Zolotarevych, Rongwei Yang, Tianming Liu

AI总结:

本研究提出LLM-POTUS Score框架,通过大语言模型从3P-3I匹配度量化评估美国总统辩论表现,为政治分析提供新工具,也助力公民独立判断、提升民主参与质量。

摘要:

大语言模型在自然语言处理领域已展现出卓越能力,但其在政治话语分析中的应用仍未得到充分探索。本文提出了一种利用大语言模型评估总统辩论表现的新方法,旨在解决长期以来客观评判辩论结果的难题。我们提出的框架会分析候选人的“政策、个人形象与立场(Policies, Persona, and Perspective,简称3P)”,以及这些特质与四类核心受众群体——选民、企业、捐赠者和政界人士——的“利益、意识形态与身份认同(Interests, Ideologies, and Identity,简称3I)”之间的共鸣程度。我们的方法利用大语言模型生成LLM-POTUS Score,这是一种基于3P与3I匹配度的辩论表现量化衡量指标。我们将该框架应用于分析近期美国总统辩论的文字记录,证明其能够对候选人表现提供细致入微的多维度评估。研究结果揭示了不同辩论策略的有效性及其对各类受众群体的影响相关洞见。本研究不仅为政治分析提供了新工具,还探究了在复杂社会语境中使用大语言模型作为中立评判者的潜力与局限性。此外,该框架为普通公民提供了评估总统辩论表现的独立工具,能够提升民主参与度,减少对可能存在偏见的媒体解读和机构影响的依赖,从而夯实知情公民参与的基础。

英文摘要:

Large language models have demonstrated remarkable capabilities in natural language processing, yet their application to political discourse analysis remains underexplored. This paper introduces a novel approach to evaluating presidential debate performances using LLMs, addressing the longstanding challenge of objectively assessing debate outcomes. We propose a framework that analyzes candidates' "Policies, Persona, and Perspective" (3P) and how they resonate with the "Interests, Ideologies, and Identity" (3I) of four key audience groups: voters, businesses, donors, and politicians. Our method employs large language models to generate the LLM-POTUS Score, a quantitative measure of debate performance based on the alignment between 3P and 3I. We apply this framework to analyze transcripts from recent U.S. presidential debates, demonstrating its ability to provide nuanced, multi-dimensional assessments of candidate performances. Our results reveal insights into the effectiveness of different debating strategies and their impact on various audience segments. This study not only offers a new tool for political analysis but also explores the potential and limitations of using LLMs as impartial judges in complex social contexts. In addition, this framework provides individual citizens with an independent tool to evaluate presidential debate performances, which enhances democratic engagement and reduces reliance on potentially biased media interpretations and institutional influence, thereby strengthening the foundation of informed civic participation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑