LawLLM: Law Large Language Model for the US Legal System
Northwestern University（西北大学）；New Jersey Institute of Technology（新泽西理工学院）；Rutgers University（罗格斯大学）
Dong Shu, Haoran Zhao, Xukun Liu, David Demeter, Mengnan Du, Yongfeng Zhang
备注：
21 pages, 2 figures, accepted at the 33rd ACM International Conference on Information and Knowledge Management (CIKM 2024) for the Applied Research Paper track
In the rapidly evolving field of legal analytics, finding relevant cases and accurately predicting judicial outcomes are challenging because of the complexity of legal language, which often includes specialized terminology, complex syntax, and historical context. Moreover, the subtle distinctions between similar and precedent cases require a deep understanding of legal knowledge. Researchers often conflate these concepts, making it difficult to develop specialized techniques to effectively address these nuanced tasks. In this paper, we introduce the Law Large Language Model (LawLLM), a multi-task model specifically designed for the US legal domain to address these challenges. LawLLM excels at Similar Case Retrieval (SCR), Precedent Case Recommendation (PCR), and Legal Judgment Prediction (LJP). By clearly distinguishing between precedent and similar cases, we provide essential clarity, guiding future research in developing specialized strategies for these tasks. We propose customized data preprocessing techniques for each task that transform raw legal data into a trainable format. Furthermore, we also use techniques such as in-context learning (ICL) and advanced information retrieval methods in LawLLM. The evaluation results demonstrate that LawLLM consistently outperforms existing baselines in both zero-shot and few-shot scenarios, offering unparalleled multi-task capabilities and filling critical gaps in the legal domain.
DISC-LawLLM: Fine-tuning Large Language Models for Intelligent Legal Services
Fudan University（复旦大学）；Huazhong University of Science and Technology（华中科技大学）；New York University Shanghai（上海纽约大学）；Northwest University of Political and Law（西北政法大学）
Capturing Legal Reasoning Paths from Facts to Law in Court Judgments using Knowledge Graphs
Graduate School of Information Science and Technology, The University of Tokyo（东京大学信息科学与技术研究生院）；The Canon Institute for Global Studies（Canon全球研究机构）；Graduate Schools for Law and Politics, The University of Tokyo（东京大学法学与政治学研究生院）；TKC Corporation（TKC公司）
LawGPT: A Chinese Legal Knowledge-Enhanced Large Language Model
National Key Laboratory for Novel Software Technology, Nanjing University（南京大学计算机软件新技术国家重点实验室）；School of Artifical Intelligence, Nanjing University（南京大学人工智能学院）；School of Intelligence Science and Technology, Nanjing University（南京大学智能科学与技术学院）
Lawma: The Power of Specialization for Legal Annotation
Max Planck Institute for Intelligent Systems（马克斯·普朗克智能系统研究所）；Tübingen AI Center（图宾根人工智能中心）；Max Planck Institute for Software Systems（马克斯·普朗克软件系统研究所）；ETH Zurich（苏黎世联邦理工学院）；Max Planck Institute for Research on Collective Goods（马克斯·普朗克集体研究研究所）；Washington University in St. Louis - School of Law（圣路易斯华盛顿大学法学院）；University of Virginia School of Law（弗吉尼亚大学法学院）
Evaluating LLM-based Approaches to Legal Citation Prediction: Domain-specific Pre-training, Fine-tuning, or RAG? A Benchmark and an Australian Law Case Study
Department of Data Science & AI, Monash University（数据科学与人工智能系，莫纳什大学）；Faculty of Law, Monash University（法学院，莫纳什大学）
LawLuo: A Multi-Agent Collaborative Framework for Multi-Round Chinese Legal Consultation
College of Computer and Control Engineering, Northeast Forestry University（东北林业大学计算机与控制工程学院）；Faculty of Information and Communication Technology, Universiti Tunku Abdul Rahman（拉曼大学信息与通信技术学院）；College of Architecture and Arts Design, Shijiazhuang Tiedao University（石家庄铁道大学建筑与艺术设计学院）
Pile of Law: Learning Responsible Data Filtering from the Law and a 256GB Open-Source Legal Dataset
Stanford University（斯坦福大学）
对大语言模型的兴起的一个担忧在于它们可能造成重大伤害，特别是在对有偏见的、淫秽的、受版权保护的和私人的信息进行预训练时。新出现的道德操守做法试图过滤培训前的材料，但这种做法是临时性的，没有考虑到背景。我们提供了一种基于法律的过滤方法，它直接解决了过滤材料的权衡问题。首先，我们收集并提供Pile of Law，这是一个256GB的开源英语法律和行政数据集，涵盖法院意见，合同，行政规则和立法记录。法律桩的预培训可能有助于有希望改善诉诸司法的法律任务。其次，我们提取了政府制定的法律规范，以限制将有毒或私人内容纳入研究人员的可操作经验教训，并讨论我们的数据集如何反映这些规范。第三，我们展示了如何桩的法律为研究人员提供了机会，直接从数据中学习这样的过滤规则，提供了一个令人兴奋的新的研究方向，在基于模型的处理。
The Measurement Gap in the Automation of EU Law: Benchmarking Doctrinal Legal Reasoning under the EU AI Act
Chair of Law and Artificial Intelligence and Director, CZS Institute for Artificial Intelligence and Law, University of Tübingen（法律与人工智能教授、人工智能与法律研究所主任，图宾根大学）
LawGPT: Knowledge-Guided Data Generation and Its Application to Legal LLM
National Key Laboratory for Novel Software Technology（现代软件工程国家重点实验室）；School of Artificial Intelligence, Nanjing University（南京大学人工智能学院）；School of Intelligence Science and Technology, Nanjing University（南京大学智能科学与技术学院）
SaulLM-7B: A pioneering Large Language Model for Law
CentraleSupélec（中央高等电力学院）；Université Paris-Saclay（巴黎萨克雷大学）；Sorbonne Université（索邦大学）；Instituto Superior Técnico（里斯本高等理工学院）；Universidade de Lisboa（里斯本大学）；NOVA School of Law（NOVA法学院）
How Do LLMs Understand Legal Philosophy? Diagnosing Legal-Philosophical Reasoning in LLMs
The University of Osaka（大阪大学）；UC Davis（加州大学戴维斯分校）；UC Berkeley（加州大学伯克利分校）；Peking University（北京大学）；University of Wisconsin–Madison（威斯康星大学麦迪逊分校）；Shanghai Jiao Tong University（上海交通大学）；NII（信息学研究所（日本））；City University of Hong Kong（香港城市大学）
Solving the Unsolvable: Translating Case Law in Hong Kong
UOW College Hong Kong（香港UOW学院）；City University of Hong Kong（香港城市大学）；The Chinese University of Hong Kong Shenzhen（香港中文大学深圳校区）；The University of Hong Kong（香港大学）
Law in Silico: Simulating Legal Society with LLM-Based Agents
Institute for Artificial Intelligence, Peking University（北京大学人工智能研究所）；Yuanpei College, Peking University（北京大学元培学院）；School of Computing and Data Science, The University of Hong Kong（香港大学计算与数据科学学院）；Law School, Peking University（北京大学法学院）；State Key Laboratory of General Artificial Intelligence, BIGAI（通用人工智能国家重点实验室）
针对现实法律实验成本高、难开展的问题，提出基于LLM的法律社会模拟框架Law in Silico，可复现宏观犯罪趋势，还揭示了完善的法律系统对弱势群体的保护作用。
Conditioning Large Language Models on Legal Systems? Detecting Punishable Hate Speech
Central Office for Information Technology in the Security Sector (ZITiS)（安全领域信息技术中央办公室（ZITiS））；Computational Linguistics, CATALPA, FernUniversität in Hagen（计算语言学、CATALPA、费尔本大学）；Karlsruhe Institute of Technology (KIT)（卡尔斯鲁厄理工学院）；Waseda Institute for Advanced Study, Waseda University（早稻田大学高级研究机构）
ASP2LJ : An Adversarial Self-Play Laywer Augmented Legal Judgment Framework
The Key Laboratory of Cognition and Decision Intelligence for Complex Systems（认知与复杂系统决策智能重点实验室）；Institute of Automation Chinese Academy of Sciences（中国科学院自动化研究所）；School of Artificial Intelligence University of Chinese Academy of Sciences（中国科学院大学人工智能学院）；Unisound Beijing China（北京Unisound）
Large Language Models as Tax Attorneys: A Case Study in Legal Capabilities Emergence
Stanford University（斯坦福大学）；University of Michigan（密歇根大学）；University of Washington（华盛顿大学）；University of Southern California（南加州大学）；Northwestern Pritzker School of Law（西北大学普利兹克法学院）；SimPPL
BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law
Technical University of Munich (TUM)（慕尼黑技术大学）；Ludwig Maximilian University of Munich (LMU)（慕尼黑路德维希-马克西米利安大学）；University of Konstanz（康斯坦茨大学）；University of Saarbrücken（萨尔布吕肯大学）
Automating Legal Interpretation with LLMs: Retrieval, Generation, and Evaluation
Wangxuan Institute of Computer Technology, Peking University（北京大学王轩计算机技术研究所）；Institute for Artificial Intelligence, Peking University（北京大学人工智能研究所）；Peking University Law School（北京大学法学院）
LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Models
Stanford University（斯坦福大学）；University of Chicago（芝加哥大学）；Maxime Tools（Maxime工具公司）；LawBeta（LawBeta机构）；South Texas College of Law Houston（休斯顿南德克萨斯法学院）；University of Toronto（多伦多大学）；St. Thomas University Benjamin L. Crump College of Law（圣托马斯大学本杰明·L·克伦普法学院）；Harvard Law School（哈佛法学院）；Stanford Center for Legal Informatics - CodeX（斯坦福法律信息学中心（CodeX））；University of Southern California（南加州大学）；Georgetown University Law Center（乔治城大学法律中心）；Stanford Law School（斯坦福法学院）；University of Virginia（弗吉尼亚大学）；Télécom Paris, Institut Polytechnique de Paris（巴黎理工学院巴黎电信学院）
NyayaRAG: Realistic Legal Judgment Prediction with RAG under the Indian Common Law System
Indian Institute of Technology Kanpur（印度理工学院坎浦尔分校）；SRM Institute of Science and Technology（SRM科学与技术学院）；Symbiosis Law School Pune（苏比斯法学院浦那分校）；IISER Kolkata（印度科学研究所库勒卡布尔分校）；University of Birmingham, Dubai, United Arab Emirates（布里斯托尔大学迪拜分校）
