LJP 从未见过的案件:面向更完整刑事责任评估的起诉决定预测
The Cases LJP Never Sees: Prosecution Decision Prediction for More Complete Criminal Liability Assessment
AI总结:
提出起诉决定预测(PDP)任务,通过分类起诉或三种不起诉决定,弥补法律判决预测(LJP)在刑事责任评估中的盲区,并构建PDP-Bench基准,实验表明大语言模型在PDP上表现显著差于LJP。
摘要:
法律判决预测(LJP)已成为评估刑事法律领域人工智能的核心基准,但它只涉及已经通过检察审查并正式起诉的刑事案件。因此,LJP在评估刑事责任方面留下了大量盲区,忽略了证据不足、无刑事责任或免予处罚的案件。为填补这一空白,我们提出了 extbf{起诉决定预测(PDP)},这是首个围绕检察审查构建的法律AI任务,它将每个案件分类为起诉或三种不起诉决定之一,并反映了法律AI在证据评估、法律归类和基于价值的裁量方面的能力。我们进一步构建了 extbf{PDP-Bench},一个包含4,630个真实中国检察决定、涵盖190个罪名的基准。大量实验表明,最先进的大语言模型在PDP上的表现显著差于LJP,且主流增强途径未能缩小差距。此外,受控的RLVR干预表明,简单的结果奖励无法产生可泛化的PDP判别能力。
英文摘要:
Legal Judgment Prediction (LJP) has become a core benchmark for evaluating AI in the criminal legal domain, but it only sees criminal cases that have already passed prosecutorial review and been formally indicted. As a result, LJP leaves a substantial blind spot in assessing criminal liability, overlooking cases involving insufficient evidence, no criminal liability, or guilt exempted from punishment. To fill this gap, we propose \textbf{Prosecution Decision Prediction (PDP)}, the first Legal AI task built around prosecutorial review, which classifies each case into prosecution or one of three non-prosecution decisions and reflects legal AI's capabilities in evidence evaluation, legal subsumption, and value-based discretion. We further construct \textbf{PDP-Bench}, a benchmark of 4{,}630 real Chinese prosecutorial decisions spanning 190 charges. Extensive experiments show that state-of-the-art LLMs perform substantially worse on PDP than on LJP and that mainstream enhancement routes fail to close the gap. Moreover, controlled RLVR interventions show that simple outcome rewards fail to produce generalizable PDP discrimination.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。