Identification of named entities from legal texts is an essential building block for developing other legal Artificial Intelligence applications. Named Entities in legal texts are slightly different and more fine-grained than commonly used named entities like Person, Organization, Location etc. In this paper, we introduce a new corpus of 46545 annotated legal named entities mapped to 14 legal entity types. The Baseline model for extracting legal named entities from judgment text is also developed.
NyayaRAG: Realistic Legal Judgment Prediction with RAG under the Indian Common Law System
Indian Institute of Technology Kanpur（印度理工学院坎浦尔分校）；SRM Institute of Science and Technology（SRM科学与技术学院）；Symbiosis Law School Pune（苏比斯法学院浦那分校）；IISER Kolkata（印度科学研究所库勒卡布尔分校）；University of Birmingham, Dubai, United Arab Emirates（布里斯托尔大学迪拜分校）
Indian Institute of Technology Kanpur（坎普尔印度理工学院）；Indian Institute of Science Education and Research Kolkata（加尔各答印度科学教育与研究学院）；West Bengal National University of Juridical Sciences（西孟加拉国立法科大学）
An automated system that could assist a judge in predicting the outcome of a case would help expedite the judicial process. For such a system to be practically useful, predictions by the system should be explainable. To promote research in developing such a system, we introduce ILDC (Indian Legal Documents Corpus). ILDC is a large corpus of 35k Indian Supreme Court cases annotated with original court decisions. A portion of the corpus (a separate test set) is annotated with gold standard explanations by legal experts. Based on ILDC, we propose the task of Court Judgment Prediction and Explanat…
Artificial intelligence is being utilized in many domains as of late, and the legal system is no exception. However, as it stands now, the number of well-annotated datasets pertaining to legal documents from the Supreme Court of the United States (SCOTUS) is very limited for public use. Even though the Supreme Court rulings are public domain knowledge, trying to do meaningful work with them becomes a much greater task due to the need to manually gather and process that data from scratch each time. Hence, our goal is to create a high-quality dataset of SCOTUS court cases so that they may be rea…
Artificial Intelligence techniques are already popular and important in the legal domain. We extract legal indicators from judicial judgment to decrease the asymmetry of information of the legal system and the access-to-justice gap. We use NLP methods to extract interesting entities/data from judgments to construct networks of lawyers and judgments. We propose metrics to rank lawyers based on their experience, wins/loss ratio and their importance in the network of lawyers. We also perform community detection in the network of judgments and propose metrics to represent the difficulty of cases c…
Peking University（北京大学）；Alibaba Group（阿里巴巴集团）；Indiana University Bloomington（印第安纳大学伯明顿分校）
Legal judgment prediction(LJP) is an essential task for legal AI. While prior methods studied on this topic in a pseudo setting by employing the judge-summarized case narrative as the input to predict the judgment, neglecting critical case life-cycle information in real court setting could threaten the case logic representation quality and prediction correctness. In this paper, we introduce a novel challenging dataset from real courtrooms to predict the legal judgment in a reasonably encyclopedic manner by leveraging the genuine input of the case -- plaintiff's claims and court debate data, fr…
This paper conducts a comparative study on the performance of various machine learning (``ML'') approaches for classifying judgments into legal areas. Using a novel dataset of 6,227 Singapore Supreme Court judgments, we investigate how state-of-the-art NLP methods compare against traditional statistical models when applied to a legal corpus that comprised few but lengthy documents. All approaches tested, including topic model, word embedding, and language model-based classifiers, performed well with as little as a few hundred judgments. However, more work needs to be done to optimize state-of-…
Legal Judgment Reimagined: PredEx and the Rise of Intelligent AI Interpretation in Indian Courts
Symbiosis Law School（symbiosis 法学院）；IISER Kolkata（印度科学教育与研究学院加尔各答分校）；Indian Institute of Technology Kanpur（坎普尔印度理工学院）；Manipal University Jaipur（斋浦尔马尼帕尔大学）
Qilu University of Technology (Shandong Academy of Sciences)（齐鲁工业大学（山东省科学院））；Shandong University（山东大学）；Shandong University of Finance and Economics（山东财经大学）
Legal Judgment Prediction (LJP) aims to automatically predict judgment results, such as charges, relevant law articles, and the term of penalty. It plays a vital role in legal assistant systems and has become a popular research topic in recent years. This paper concerns a worthwhile but not well-studied LJP task, Appeal judgment Prediction (AJP), which predicts the judgment of an appellate court on an appeal case based on the textual description of case facts and grounds of appeal. There are two significant challenges in practice to solve the AJP task. One is how to model the appeal judgment p…
Graduate Institute of International and Development Studies（日内瓦高级国际关系及发展学院）；Technical University of Munich（慕尼黑工业大学）
This work demonstrates that Legal Judgement Prediction systems without expert-informed adjustments can be vulnerable to shallow, distracting surface signals that arise from corpus construction, case distribution, and confounding factors. To mitigate this, we use domain expertise to strategically identify statistically predictive but legally irrelevant information. We adopt adversarial training to prevent the system from relying on it. We evaluate our deconfounded models by employing interpretability techniques and comparing to expert annotations. Quantitative experiments and qualitative analys…
Capturing Legal Reasoning Paths from Facts to Law in Court Judgments using Knowledge Graphs
Graduate School of Information Science and Technology, The University of Tokyo（东京大学信息科学与技术研究生院）；The Canon Institute for Global Studies（Canon全球研究机构）；Graduate Schools for Law and Politics, The University of Tokyo（东京大学法学与政治学研究生院）；TKC Corporation（TKC公司）
Dhirubhai Ambani Institute of Information and Communication Technology（迪鲁巴伊·安巴尼信息与通信技术学院）；Malaviya National Institute of Technology（马拉维亚国家理工学院）；Paramonic AI
Unlike the courts in western countries, public records of Indian judiciary are completely unstructured and noisy. No large scale publicly available annotated datasets of Indian legal documents exist till date. This limits the scope for legal analytics research. In this work, we propose a new dataset consisting of over 10,000 judgements delivered by the supreme court of India and their corresponding hand written summaries. The proposed dataset is pre-processed by normalising common legal abbreviations, handling spelling variations in named entities, handling bad punctuations and accurate senten…
University of Bern（伯尔尼大学）；University of Copenhagen（哥本哈根大学）
In many jurisdictions, the excessive workload of courts leads to high delays. Suitable predictive AI models can assist legal professionals in their work, and thus enhance and speed up the process. So far, Legal Judgment Prediction (LJP) datasets have been released in English, French, and Chinese. We publicly release a multilingual (German, French, and Italian), diachronic (2000-2020) corpus of 85K cases from the Federal Supreme Court of Switzerland (FSCS). We evaluate state-of-the-art BERT-based methods including two variants of BERT that overcome the BERT input (text) length limitation (up to…
Athens University of Economics and Business（雅典经济与商业大学）；University of Sheffield（谢菲尔德大学）
Legal judgment prediction is the task of automatically predicting the outcome of a court case, given a text describing the case's facts. Previous work on using neural models for this task has focused on Chinese; only feature-based models (e.g., using bags of words and topics) have been considered in English. We release a new English legal judgment prediction dataset, containing cases from the European Court of Human Rights. We evaluate a broad variety of neural models on the new dataset, establishing strong baselines that surpass previous feature-based models in three tasks: (1) binary violati…
NyayaMind- A Framework for Transparent Legal Reasoning and Judgment Prediction in the Indian Legal System
IIT Kanpur, India（印度理工学院坎普尔分校）；IIT Kharagpur, India（印度理工学院克勒格布尔分校）；Symbiosis Law School Pune, India（印度共生法学院浦那分校）；Dattam Labs, India（印度Dattam实验室）；University of Birmingham, Dubai, United Arab Emirates（英国伯明翰大学迪拜校区）
From Judgments to Issues: Structured Extraction of Legal Reasoning with Citation-Hallucination Control
Quantitative and Digital Law Laboratory（量化与数字法律实验室）；CIRSFID - Alma AI, Faculty of Law University of Bologna（CIRSFID - 阿尔玛AI，博洛尼亚大学法学院）；Robert Schuman Centre European University Institute（罗伯特·施曼中心欧洲大学研究所）
Revisiting Metric Reliability for Fine-grained Evaluation of Machine Translation and Summarization in Indian Languages
Sharif University of Technology（谢里夫理工学院）；Vellore Institute of Technology（韦洛雷理工学院）；IIT Kharagpur（印度理工学院达卡分校）；Mohamed bin Zayed University of Artificial Intelligence（穆罕默德·本·扎耶德人工智能大学）
Government College Of Engineering And Textile Technology（政府工程与纺织技术学院）；Indian Institute of Technology Patna（印度理工学院巴特那分校）
In this article, we present a description of our systems as a part of our participation in the shared task namely Artificial Intelligence for Legal Assistance (AILA 2019). This is an integral event of Forum for Information Retrieval Evaluation-2019. The outcomes of this track would be helpful for the automation of the working process of the Indian Judiciary System. The manual working procedures and documentation at any level (from lower to higher court) of the judiciary system are very complex in nature. The systems produced as a part of this track would assist the law practitioners. It would …
In the Indian court system, pending cases have long been a problem. There are more than 4 crore cases outstanding. Manually summarising hundreds of documents is a time-consuming and tedious task for legal stakeholders. Many state-of-the-art models for text summarization have emerged as machine learning has progressed. Domain-independent models don't do well with legal texts, and fine-tuning those models for the Indian Legal System is problematic due to a lack of publicly available datasets. To improve the performance of domain-independent models, the authors have proposed a methodology for nor…
School of Computer Science and Statistics, Trinity College（都柏林圣三一学院计算机科学与统计学院）；ADAPT Centre（ADAPT中心）
In this study, machine learning models were constructed to predict whether judgments made by the European Court of Human Rights (ECHR) would lead to a violation of an Article in the Convention on Human Rights. The problem is framed as a binary classification task where a judgment can lead to a "violation" or "non-violation" of a particular Article. Using auto-sklearn, an automated algorithm selection package, models were constructed for 12 Articles in the Convention. To train these models, textual features were obtained from the ECHR Judgment documents using N-grams, word embeddings and paragr…
INACIA: Integrating Large Language Models in Brazilian Audit Courts: Opportunities and Challenges
University of Campinas（坎皮纳斯大学）；National Center for State Courts (NCSC)（国家州法院中心）；Brazilian Association of Jurimetrics (ABJ)（巴西司法计量协会）；Terranova Consultoria（Terranova咨询公司）；Brazilian Federal Court of Accounts (TCU)（巴西联邦审计法院）
Technical University of Munich（慕尼黑工业大学）；Graduate Institute of International and Development Studies（日内瓦高级国际关系及发展学院）
In this paper, we cast Legal Judgment Prediction on European Court of Human Rights cases into an article-aware classification task, where the case outcome is classified from a combined input of case facts and convention articles. This configuration facilitates the model learning some legal reasoning ability in mapping article text to specific case fact text. It also provides an opportunity to evaluate the model's ability to generalize to zero-shot settings when asked to classify the case outcome with respect to articles not seen during training. We devise zero-shot experiments and apply domain…
AgentsCourt: Building Judicial Decision-Making Agents with Court Debate Simulation and Legal Knowledge Augmentation
Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所）；School of Artificial Intelligence, University of Chinese Academy of Sciences（中国科学院大学人工智能学院）
