Stance detection identifies the attitude of a text author toward a given target. Recent studies have explored various LLM-based strategies for this task, from zero-shot prompting to multi-agent debate. However, existing works differ in data splits, base models, and evaluation protocols, making fair comparison difficult. We conduct a systematic comparison that evaluates five methods across two categories -- prompt-based inference (Direct Prompting, Auto-CoT, StSQA) and agent-based debate (COLA, MPRF) -- on four datasets with 14 subtasks, using 15 LLMs from six model families with parameter sizes from 7B to 72B+. Our experiments yield several findings. First, on all models with complete results, the best prompt-based method outperforms the best agent-based method, while agent methods require 7 to 12 times more API calls per sample. Second, model scale has a larger impact on performance than method choice, with gains plateauing around 32B. Third, reasoning-enhanced models (DeepSeek-R1) do not consistently outperform general models of the same size on this task.
Contextualized Prompting For Stance Detection On Social Media
Institute of Intensive Care, University Hospital of Zurich and University of Zurich(重症医学研究所,苏黎世大学医院和苏黎世大学);Institute of Computer Science, University of Goettingen(计算机科学研究所,哥廷根大学);GESIS Leibniz Institute for the Social Sciences(社会科学研究莱比锡研究所);Institut für Publizistik, Johannes Gutenberg-University Mainz(主笔研究所,美因茨约翰· Gutenberg 大学);Ubiquitous Knowledge Processing Lab, Technical University of Darmstadt(无处不在知识处理实验室,达姆施塔特技术大学)
Contextual information integration for stance detection via cross-attention
Technical University of Darmstadt(达姆施塔特工业大学);Hessian Center for AI (hessian.AI)(黑森人工智能中心);Lucerne University of Applied Sciences and Arts(卢塞恩应用科学与艺术大学)
SICI: A Semantic-Pragmatic Complexity Index Reveals Regime Shifts in LLM Stance Detection
School of Cyber Science and Technology, University of Science and Technology of China(中国科学技术大学网络空间安全学院);School of Artificial Intelligence, Shenzhen Technology University(深圳技术大学人工智能学院)
Large Language Models Unpack Complex Political Opinions through Target-Stance Extraction
Department of Methodology and Statistics, Utrecht University(方法论与统计学系,乌特雷赫特大学);Department of Languages, Literature and Communication, Utrecht University(语言、文学与传播系,乌特雷赫特大学)
Understanding and Mitigating Political Stance Cross-topic Generalization in Large Language Models
Provable Responsible AI and Data Analytics (PRADA) Lab(可证明负责任的人工智能和数据分析实验室);King Abdullah University of Science and Technology (KAUST)(卡布斯科学技术大学);University of Copenhagen(哥本哈根大学);University of Macau(澳门大学)
Optimizing Social Media Annotation of HPV Vaccine Skepticism and Misinformation Using Large Language Models: An Experimental Evaluation of In-Context Learning and Fine-Tuning Stance Detection Across Multiple Models
School of Journalism and Mass Communication, University of Wisconsin–Madison(威斯康星大学麦迪逊分校新闻与大众传播学院);Department of Electrical & Computer Engineering, University of Wisconsin–Madison(威斯康星大学麦迪逊分校电气与计算机工程系);Department of Computer Science, University of Wisconsin–Madison(威斯康星大学麦迪逊分校计算机科学系);Department of Psychology, University of Wisconsin–Madison(威斯康星大学麦迪逊分校心理学系);School of Interactive Computing, Georgia Institute of Technology(佐治亚理工学院交互计算学院);Institute of People and Technology, Georgia Institute of Technology(佐治亚理工学院人与技术研究所)
Ladder-of-Thought: Using Knowledge as Steps to Elevate Stance Detection
Centre for Frontier AI Research (CFAR), A*STAR(新加坡科技研究局前沿人工智能研究中心(CFAR));Institute of High Performance Computing (IHPC), A*STAR(新加坡科技研究局高性能计算研究所(IHPC));DSO National Laboratories(DSO国家实验室)
Acting Flatterers via LLMs Sycophancy: Combating Clickbait with LLMs Opposing-Stance Reasoning
Yangzhou University(扬州大学);Auburn University(亚伯拉罕大学);University of South Dakota(南达科他大学);Institute for Clarity in Documentation(文档清晰研究所);Inria Paris-Rocquencourt(巴黎-罗quentourt研究所);Rajiv Gandhi University(拉贾夫·甘地大学);Tsinghua University(清华大学);Palmer Research Laboratories(帕勒尔研究实验室)
A Survey of Stance Detection on Social Media: New Directions and Perspectives
College of Big Data and Internet, Shenzhen Technology University(深圳技术大学大数据与互联网学院);College of Computer Science and Software, Shenzhen University(深圳大学计算机与软件学院);Hong Kong University of Science and Technology(香港科技大学);School of Computer Science and Engineering, Central South University(中南大学计算机科学与工程学院);School of Cyber Science and Technology, Shenzhen Campus of Sun Yat-sen University(中山大学深圳校区网络空间安全学院);Peking University Shenzhen Graduate School(北京大学深圳研究生院)
Large Language Models Meet Stance Detection: A Survey of Tasks, Methods, Applications, Challenges and Future Directions
Department of Computer Science and Engineering, Indian Institute of Technology (IIT) Indore, Indore 453552, India(计算机科学与工程系,印度理工学院(IIT)印多尔,印多尔453552,印度)
Department of Linguistics, University of British Columbia(不列颠哥伦比亚大学语言学系);Department of Political Science, University of Toronto Scarborough(多伦多大学斯卡伯勒分校政治学系);Vector Institute, Department of Computer Science, University of Toronto(向量研究所、多伦多大学计算机科学系)
Benchmarking zero-shot stance detection with FlanT5-XXL: Insights from training data, prompting, and decoding strategies into its near-SoTA performance
Indiana University Bloomington(印第安纳大学伯明顿分校);Center for Complex Networks and Systems(复杂网络与系统中心)
When Less Is Enough: Context Selection and Prompting Strategies for Bengali News Headline Generation
Charles Sturt University(查尔斯斯特大学);Chittagong University of Engineering and Technology(吉大港工程技术大学);Bangladesh Army University of Science and Technology(孟加拉国陆军理工大学)