VECHR: A Dataset for Explainable and Robust Classification of Vulnerability Type in the European Court of Human Rights
Technical University of Munich(慕尼黑工业大学);LMU Munich(慕尼黑大学);Graduate Institute of International and Development Studies(日内瓦高级国际关系及发展学院);University of Zürich(苏黎世大学)
Shanshan Xu, Leon Staufer, T. Y. S. S Santosh, Oana Ichim, Corina Heri, Matthias Grabmair
Recognizing vulnerability is crucial for understanding and implementing targeted support to empower individuals in need. This is especially important at the European Court of Human Rights (ECtHR), where the court adapts Convention standards to meet actual individual needs and thus ensures effective human rights protection. However, the concept of vulnerability remains elusive at the ECtHR and no prior NLP research has dealt with it. To enable future research in this area, we present VECHR, a novel expert-annotated multi-label dataset comprising of vulnerability type classification and explanation rationale. We benchmark the performance of state-of-the-art models on VECHR from both prediction and explainability perspectives. Our results demonstrate the challenging nature of the task with lower prediction performance and limited agreement between models and experts. Further, we analyze the robustness of these models in dealing with out-of-domain (OOD) data and observe overall limited performance. Our dataset poses unique challenges offering significant room for improvement regarding performance, explainability, and robustness.
Paragraph-level Rationale Extraction through Regularization: A case study on European Court of Human Rights Cases
EY AI Centre of Excellence in Document Intelligence(安永文档智能人工智能卓越中心);NCSR “Demokritos”(希腊德谟克利特国家科学研究中心);Athens University of Economics and Business(雅典经济与商业大学);University of Sheffield(谢菲尔德大学);University of York(约克大学)
LexGenie: Automated Generation of Structured Reports for European Court of Human Rights Case Law
School of Computation, Information, and Technology(计算、信息与技术学院;慕尼黑工业大学);Technical University of Munich(国际与发展研究研究生院);Graduate Institute of International and Development Studies
LaCour!: Enabling Research on Argumentation in Hearings of the European Court of Human Rights
Technical University of Darmstadt(达姆施塔特工业大学);Ruhr University Bochum(波鸿鲁尔大学);University Alliance Ruhr(鲁尔大学联盟);Trustworthy Human Language Technologies(可信人类语言技术中心);Research Center Trustworthy Data Science and Security(可信数据科学与安全研究中心)
Combining topic modelling and citation network analysis to study case law from the European Court on Human Rights on the right to respect for private and family life
Can LLMs Reason in a Legally Meaningful Manner? A Small-scale Study on European Court of Human Rights Cases
University of Copenhagen(哥本哈根大学);Faculty of Law, University of Copenhagen(哥本哈根大学法学院);Department of Computer Science, University of Copenhagen(哥本哈根大学计算机科学系)
Through the Lens of Split Vote: Exploring Disagreement, Difficulty and Calibration in Legal Case Outcome Classification
Technical University of Munich(慕尼黑工业大学);Graduate Institute of International and Development Studies(国际与发展研究研究生院);IT University of Copenhagen(哥本哈根IT大学);LMU Munich(慕尼黑大学);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心);ELTEMATE
Legal Experts Disagree With Rationale Extraction Techniques for Explaining ECtHR Case Outcome Classification
Trustworthy Human Language Technologies, Research Center Trustworthy Data Science and Security of the University Alliance Ruhr, Ruhr University Bochum(鲁尔大学联盟可信数据科学与安全研究中心,可信人类语言技术,波鸿鲁尔大学);Center for Critical Computational Studies, Goethe University Frankfurt(法兰克福歌德大学关键计算研究中心)