Language serves as a vehicle for conveying thought, enabling communication among individuals. The ability to distinguish between diverse concepts, identify fairness and injustice, and comprehend a range of legal notions fundamentally relies on logical reasoning. Large Language Models (LLMs) attempt to emulate human language understanding and generation, but their competency in logical reasoning remains limited. This paper seeks to address the philosophical question: How can we effectively teach logical reasoning to LLMs while maintaining a deep understanding of the intricate relationship between language and logic? By focusing on bolstering LLMs' capabilities in logical reasoning, we aim to expand their applicability in law and other logic-intensive disciplines. To this end, we propose a Reinforcement Learning from Logical Feedback (RLLF) approach, which serves as a potential framework for refining LLMs' reasoning capacities. Through RLLF and a revised evaluation methodology, we explore new avenues for research in this domain and contribute to the development of LLMs capable of handling complex legal reasoning tasks while acknowledging the fundamental connection between language and logic.
Can LLMs Time Travel? Enhancing Temporal Consistency in Legal Agentic Search through Reinforcement Learning
Department of Computer Science and Engineering, HKUST, Hong Kong SAR, China(香港科技大学计算机科学与工程系);School of Law, Tsinghua University, Beijing, China(清华大学法学院);Cheriton School of Computer Science, University of Waterloo, Waterloo, Canada(滑铁卢大学丘成桐计算机科学系)
Know Your Limits : On the Faithfulness of LLMs as Solvers and Autoformalizers in Legal Reasoning
UC Santa Cruz(加州大学圣克鲁兹分校);Univ. Helsinki(赫尔辛基大学);CodeX, Stanford(斯坦福大学CodeX中心);Stanford University(斯坦福大学);Canyon Crest Academy(峡谷峰学院);Monta Vista High School(蒙塔维斯塔高中);Los Altos High School(洛斯阿尔托斯高中)
Legal$Δ$: Enhancing Legal Reasoning in LLMs via Reinforcement Learning with Chain-of-Thought Guided Information Gain
School of Computer Science and Engineering, Northeastern University(东北大学计算机科学与工程学院);Department of Computer Science and Technology, Institute for AI, Tsinghua University(清华大学人工智能研究院计算机科学与技术系);Microsoft Research Asia(微软亚洲研究院)
Enhancing Pre-Trained Language Models with Sentence Position Embeddings for Rhetorical Roles Recognition in Legal Opinions
Nantes Université(南特大学);École Centrale Nantes(南特中央理工学院);CNRS(法国国家科学研究中心);LS2N(南特数字科学实验室);Peoples' Friendship University of Russia (RUDN University)(俄罗斯人民友谊大学(RUDN大学));Joint Institute for Nuclear Research(联合核研究所);Vrije Universiteit Amsterdam(阿姆斯特丹自由大学);University of Skövde(舍夫德大学)
An Explicit Syllogistic Legal Reasoning Framework for Large Language Models
Gaoling School of Artificial Intelligence(人工智能学院);Renmin University of China(中国人民大学);School of Information Technology and Management(信息科技与管理学院);University of International Business and Economics(国际经济贸易大学)
Large Language Models Meet Legal Artificial Intelligence: A Survey
School of Computer Science and Engineering, Sun Yat-sen University(中山大学计算机科学与工程学院);China Mobile Internet Co., Ltd.(中国移动互联网有限公司);School of Computer Science, South China Normal University(华南师范大学计算机科学学院)
RLJP: Legal Judgment Prediction via First-Order Logic Rule-enhanced with Large Language Models
College of Computer Science and Technology, National University of Defense and Technology(国防科技大学计算机科学与技术学院);College of Electronic Engineering, National University of Defense Technology(国防科技大学电子工程学院);School of Data and Computer Science, Shandong Women’s University(山东女子大学数据与计算机科学学院);Institute for Artificial Intelligence, Tsinghua University(清华大学人工智能研究院)
Logical Structure as Knowledge: Enhancing LLM Reasoning via Structured Logical Knowledge Density Estimation
Huzhou University(湖州大学);Zhejiang Key Laboratory of Intelligent Education Technology and Application(浙江智能教育技术与应用重点实验室);Banbu AI Foundation(Banbu AI基金会);Baichuan Inc(白川公司);University of Edinburgh(爱丁堡大学);Zhejiang University(浙江大学)
Logic Rules as Explanations for Legal Case Retrieval
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);School of Information Technology and Management, University of International Business and Economics(对外经济贸易大学信息技术与管理学院)
Assessing and Enhancing the Robustness of Large Language Models with Task Structure Variations for Logical Reasoning
Strong AI Lab, NAOInstitute, Waipapa Taumata Rau - The University of Auckland(强人工智能实验室、NAO研究所、怀帕帕·陶马陶·劳 - 奥克兰大学);Xtracta, New Zealand(Xtracta公司);School of Computer Science and Engineering, Sun Yat-Sen University(中山大学计算机科学与工程学院)
Large Language Models as Tax Attorneys: A Case Study in Legal Capabilities Emergence
Stanford University(斯坦福大学);University of Michigan(密歇根大学);University of Washington(华盛顿大学);University of Southern California(南加州大学);Northwestern Pritzker School of Law(西北大学普利兹克法学院);SimPPL
Toward Robust Legal Text Formalization into Defeasible Deontic Logic using LLMs
TU Wien(维也纳技术大学);AIT Austrian Institute of Technology(奥地利技术研究所);School of Engineering and Technology(工程与技术学院);Artificial Intelligence and Cyber Futures Institute(人工智能与未来网络研究院)
AgentCourt: Simulating Court with Adversarial Evolvable Lawyer Agents
Southern University of Science and Technology(南方科技大学);Shenzhen Key Laboratory for High Performance Data Mining, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(深圳高性能数据挖掘重点实验室,深圳先进技术研究所,中国科学院);SIAT-DELI AI and Law Joint Lab(SIAT-DELI人工智能与法律联合实验室);Shenzhen MSU-BIT University(深圳MSU-BIT大学);UNSW Sydney(新南威尔士大学悉尼分校);SUAT(南方科技大学)
LegalOne: A Family of Foundation Models for Reliable Legal Reasoning
Department of Computer Science, Tsinghua University(清华大学计算机科学系);Quancheng Laboratory(清华云城实验室);University of Waterloo, Canada(加拿大滑铁卢大学);China University of Political Science and Law(中国政法大学);MegaTech.AI Inc(MegaTech.AI公司)
Enhancing Logical Reasoning in Language Models via Symbolically-Guided Monte Carlo Process Supervision
School of Computer Science, University of Sheffield(谢菲尔德大学计算机科学学院);School of Electronic Engineering and Computer Science, Queen Mary University of London(伦敦大学玛丽女王学院电子工程与计算机科学学院);The Alan Turing Institute(艾伦·图灵研究所)
JPO: Juris Policy Optimization for Structured Legal Reasoning in Criminal Judgment Prediction
Tencent(腾讯);Peking University(北京大学);Tsinghua University(清华大学);City University of Hong Kong(香港城市大学);University of California(加利福尼亚大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Zhejiang University(浙江大学);University of Hong Kong(香港大学)