Case-Based Reasoning with Language Models for Classification of Logical Fallacies
Information Sciences Institute, University of Southern California(南加州大学信息科学研究所);University of Southern California(南加州大学);armasuisse Science and Technology(瑞士军备科学与技术局)
Zhivar Sourati, Filip Ilievski, Hông-Ân Sandlin, Alain Mermoud
The ease and speed of spreading misinformation and propaganda on the Web motivate the need to develop trustworthy technology for detecting fallacies in natural language arguments. However, state-of-the-art language modeling methods exhibit a lack of robustness on tasks like logical fallacy classification that require complex reasoning. In this paper, we propose a Case-Based Reasoning method that classifies new cases of logical fallacy by language-modeling-driven retrieval and adaptation of historical cases. We design four complementary strategies to enrich input representation for our model, based on external information about goals, explanations, counterarguments, and argument structure. Our experiments in in-domain and out-of-domain settings indicate that Case-Based Reasoning improves the accuracy and generalizability of language models. Our ablation studies suggest that representations of similar cases have a strong impact on the model performance, that models perform well with fewer retrieved cases, and that the size of the case database has a negligible effect on the performance. Finally, we dive deeper into the relationship between the properties of the retrieved cases and the model performance.
Robust and Explainable Identification of Logical Fallacies in Natural Language Arguments
University of Southern California(南加州大学);Information Sciences Institute(信息科学研究所);armasuisse Science and Technology(瑞士联邦国防采购局科学技术部);Cyber-Defence Campus(网络防御园区)
A Closer Look at the Self-Verification Abilities of Large Language Models in Logical Reasoning
Institute for Artificial Intelligence, Tsinghua University(清华大学人工智能研究院);Beijing National Research Center for Information Science and Technology(北京信息科学与技术国家研究中心);Tencent AI Lab(腾讯AI实验室)
Max Planck Institute(马克斯·普朗克研究所);ETH Zürich(苏黎世联邦理工学院);BITS Pilani(博拉理工学院);IIT Kharagpur(印度理工学院克勒格布尔分校);Saarland Informatics Campus(萨尔兰信息学园区);University of Michigan(密歇根大学);University of Hong Kong(香港大学)
LLMs can persuade only psychologically susceptible humans on societal issues, via trust in AI and emotional appeals, amid logical fallacies
organization= CogNosco Lab, Department of Psychology;Cognitive Science, University of Trento , city= Rovereto , country= Italy;organization= Institute of Information Science;Technologies ``Alessandro Faedo", National Research Council , country= Italy;organization= Thomas Lord Department of Computer Science, University of Southern California , city= Los Angeles , state= California , country= USA;organization= Department of Sociology;Social Research, University of Trento , city= Trento , country= Italy;organization= Centre for Behavioural;Implementation Sciences in Medicine (BISI), National University of Singapore , city= Singapore , country= Singapore
Order Doesn't Matter, But Reasoning Does: Training LLMs with Order-Centric Augmentation
Shanghai Key Laboratory of Data Science, School of Computer Science, Fudan University(上海数据科学关键实验室,计算机科学学院,复旦大学);School of Data Science, Fudan University(数据科学学院,复旦大学);Ant Group(蚂蚁集团)
DetermLR: Augmenting LLM-based Logical Reasoning from Indeterminacy to Determinacy
XiaoMi AI Lab(小米AI实验室);Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);University of Electronic Science and Technology of China(电子科技大学)
SALA: Semantic-Aware Logical Alignment for Complex Reasoning in In-Context Learning
School of Software Engineering, Sun Yat-sen University(中山大学软件工程学院);School of Artificial Intelligence, Sun Yat-sen University(中山大学人工智能学院);Merchants Union Consumer Finance Company Limited(招商局联融消费金融股份有限公司)
Exploring Generalization Ability of Pretrained Language Models on Arithmetic and Logical Reasoning
Zhejiang University(浙江大学);Westlake University(西湖大学);Westlake Institute for Advanced Study(西湖高等研究院);Johns Hopkins University(约翰斯·霍普金斯大学);Imperial College London(帝国理工学院)
Logical Structure as Knowledge: Enhancing LLM Reasoning via Structured Logical Knowledge Density Estimation
Huzhou University(湖州大学);Zhejiang Key Laboratory of Intelligent Education Technology and Application(浙江智能教育技术与应用重点实验室);Banbu AI Foundation(Banbu AI基金会);Baichuan Inc(白川公司);University of Edinburgh(爱丁堡大学);Zhejiang University(浙江大学)
Improved Logical Reasoning of Language Models via Differentiable Symbolic Programming
Carnegie Mellon University(卡内基梅隆大学);University of Pennsylvania(宾夕法尼亚大学);Mohamed Bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);Petuum Inc.(Petuum公司)