Proving mathematical theorems using computer-verifiable formal languages like Lean significantly impacts mathematical reasoning. One approach to formal theorem proving involves generating complete proofs using Large Language Models (LLMs) based on Natural Language (NL) proofs. However, due to the scarcity of aligned NL and Formal Language (FL) theorem-proving data most modern LLMs exhibit suboptimal performance.This scarcity results in a paucity of methodologies for training LLMs and techniques to fully utilize their capabilities in composing formal proofs. To address these challenges, this paper proposes TheoremLlama, an end-to-end framework that trains a general-purpose LLM to be a Lean4 expert. TheoremLlama includes NL-FL dataset generation and bootstrapping method to obtain aligned dataset, curriculum learning and block training techniques to train the model, and iterative proof writing method to write Lean4 proofs that work together synergistically. Using the dataset generation method in TheoremLlama, we provide Open Bootstrapped Theorems (OBT), an NL-FL aligned and bootstrapped dataset. Our novel NL-FL bootstrapping method, where NL proofs are integrated into Lean4 code for training datasets, leverages the NL reasoning ability of LLMs for formal reasoning. The TheoremLlama framework achieves cumulative accuracies of 36.48% and 33.61% on MiniF2F-Valid and Test datasets respectively, surpassing the GPT-4 baseline of 22.95% and 25.41%. Our code, model checkpoints, and the generated dataset is published in GitHub
A Path Towards Legal Autonomy: An interoperable and explainable approach to extracting, transforming, loading and computing legal information using large language models, expert systems and Bayesian networks
The University of Sussex(萨塞克斯大学);Maastricht University(马斯特里赫特大学);Massachusetts Institute of Technology(麻省理工学院);VERSES Research Lab(VERSES 研究实验室);Macquarie University(麦考瑞大学);Université du Québec à Montréal(蒙特利尔魁北克大学);University College London(伦敦大学学院)
Transforming the Voice of the Customer: Large Language Models for Identifying Customer Needs
Kellogg School of Management, Northwestern University(西北大学凯洛格管理学院);MIT Management School, Massachusetts Institute of Technology(麻省理工学院斯隆管理学院);Applied Marketing Science, Inc.(应用营销科学公司)
V-Reflection: Transforming MLLMs from Passive Observers to Active Interrogators
AI Thrust, The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州)人工智能方向);International Digital Economy Academy(国际数字经济学院);MedVisAI Lab, Lee Kong Chian School of Medicine, Nanyang Technological University, and Centre of AI in Medicine(医学视觉人工智能实验室,南洋理工大学Lee Kong Chian医学院,以及人工智能在医学中的中心);South China University of Technology(华南理工大学);Department of Electrical and Electronic Engineering, The Hong Kong Polytechnic University(香港理工大学电子与电气工程系)
G-SHARE: A Guideline-Based Structured Reasoning Framework for Human-Factor Event Diagnosis
Institute of Nuclear and New Energy Technology, Tsinghua University(清华大学核能与新能源技术研究院);National Key Laboratory of Human Factors Engineering(人因工程重点实验室);Fujian Fuqing Nuclear Power Co., Ltd.(福建福清核电有限公司)
METEOR: Evolutionary Journey of Large Language Models from Guidance to Self-Growth
School of Computer Science and Technology, Beijing Institute of Technology(北京理工大学计算机科学与技术学院);Beijing University of Posts and Telecommunications(北京邮电大学)