Existing methods on understanding the capabilities of LLMs in logical reasoning rely on binary entailment classification or synthetically derived rationales, which are not sufficient for proper investigation of model's capabilities. We present P-FOLIO, a human-annotated dataset consisting of diverse and complex reasoning chains for a set of realistic logical reasoning stories also written by humans. P-FOLIO is collected with an annotation protocol that facilitates humans to annotate well-structured natural language proofs for first-order logic reasoning problems in a step-by-step manner. The number of reasoning steps in P-FOLIO span from 0 to 20. We further use P-FOLIO to evaluate and improve large-language-model (LLM) reasoning capabilities. We evaluate LLM reasoning capabilities at a fine granularity via single-step inference rule classification, with more diverse inference rules of more diverse and higher levels of complexities than previous works. Given that a single model-generated reasoning chain could take a completely different path than the human-annotated one, we sample multiple reasoning chains from a model and use pass@k metrics for evaluating the quality of model-generated reasoning chains. We show that human-written reasoning chains significantly boost the logical reasoning capabilities of LLMs via many-shot prompting and fine-tuning. Furthermore, fine-tuning Llama3-7B on P-FOLIO improves the model performance by 10% or more on three other out-of-domain logical reasoning datasets. We also conduct detailed analysis to show where most powerful LLMs fall short in reasoning. We will release the dataset and code publicly.
FOLIO: Natural Language Reasoning with First-Order Logic
Yale University(耶鲁大学);Harvard University(哈佛大学);NVIDIA(英伟达);Iowa City West High School(爱荷华城西部高中);University of Washington(华盛顿大学);University of Hong Kong(香港大学);Penn State University(宾夕法尼亚州立大学);Salesforce Research(Salesforce研究院);Meta AI
DetermLR: Augmenting LLM-based Logical Reasoning from Indeterminacy to Determinacy
XiaoMi AI Lab(小米AI实验室);Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);University of Electronic Science and Technology of China(电子科技大学)
Enhancing Logical Reasoning in Language Models via Symbolically-Guided Monte Carlo Process Supervision
School of Computer Science, University of Sheffield(谢菲尔德大学计算机科学学院);School of Electronic Engineering and Computer Science, Queen Mary University of London(伦敦大学玛丽女王学院电子工程与计算机科学学院);The Alan Turing Institute(艾伦·图灵研究所)
Coherence Under Commitment: Probing Generalization and Vacuous Memorization in LLM Logical Reasoning
Department of Computer Science, Informatics Institute, Istanbul Technical University(伊斯坦布尔技术大学信息学研究所计算机科学系);School of Information Technology, Deakin University(迪肯大学信息技术学院)
Com$^2$: A Causal-Guided Benchmark for Exploring Complex Commonsense Reasoning in Large Language Models
Research Center for Social Computing and Interactive Robotics(社会计算与交互机器人研究中心);Harbin Institute of Technology(哈尔滨工业大学);Institute of Trustworthy Embodied AI(可信具身人工智能研究院);Fudan University(复旦大学);Beijing Academy of Artificial Intelligence(北京人工智能研究院);Nanjing University(南京大学)
Towards Symbolic XAI -- Explanation Through Human Understandable Logical Relationships Between Features
Berlin Institute for the Foundations of Learning(柏林学习与数据基础研究所);Machine Learning Group, Technical University of Berlin(柏林技术大学机器学习组);Department of Artificial Intelligence, Korea University(韩国大学人工智能系);Department of Mathematics and Computer Science, Free University of Berlin(柏林自由大学数学与计算机科学系)