arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2601.00166cs.CL
收藏

Pat-DEVAL: 专利描述的法律思维链评估

Pat-DEVAL: Chain-of-Legal-Thought Evaluation for Patent Description

Macquarie University(麦考瑞大学);Amazon(亚马逊公司)

Yongmin Yoo, Kris W Pan

AI总结:

Pat-DEVAL通过法律约束的推理机制,首次提出评估专利描述的多维框架,显著提升法律合规性评估效果。

摘要:

专利描述必须在提供全面技术披露的同时满足严格的法律标准,如充分性要求和书面描述要求。尽管大型语言模型已使端到端的自动专利起草成为可能,但现有评估方法未能评估长格式结构连贯性和特定于描述的法定合规性。我们提出了Pat-DEVAL,这是首个专注于专利描述体的多维评估框架。借助LLM作为法官的范式,Pat-DEVAL引入了法律约束的推理机制,即法律思维链(CoLT),以强制性地进行连续的专利法特定分析。通过专利专家在我们Pap2Pat-EvalGold数据集上的实验验证,Pat-DEVAL实现了0.69的皮尔逊相关系数,显著优于基线指标和现有LLM评估器。值得注意的是,该框架在法律专业合规性方面表现出0.73的更高相关性,证明了显式注入法定约束对于捕捉细微法律有效性的重要性。通过建立确保技术正确性和法律合规性的新标准,Pat-DEVAL为自动专利起草系统的实际部署提供了稳健的方法论基础。

英文摘要:

Patent descriptions must deliver comprehensive technical disclosure while meeting strict legal standards such as enablement and written description requirements. Although large language models have enabled end-to-end automated patent drafting, existing evaluation approaches fail to assess long-form structural coherence and statutory compliance specific to descriptions. We propose Pat-DEVAL, the first multi-dimensional evaluation framework dedicated to patent description bodies. Leveraging the LLM-as-a-judge paradigm, Pat-DEVAL introduces Chain-of-Legal-Thought (CoLT), a legally-constrained reasoning mechanism that enforces sequential patent-law-specific analysis. Experiments validated by patent expert on our Pap2Pat-EvalGold dataset demonstrate that Pat-DEVAL achieves a Pearson correlation of 0.69, significantly outperforming baseline metrics and existing LLM evaluators. Notably, the framework exhibits a superior correlation of 0.73 in Legal-Professional Compliance, proving that the explicit injection of statutory constraints is essential for capturing nuanced legal validity. By establishing a new standard for ensuring both technical soundness and legal compliance, Pat-DEVAL provides a robust methodological foundation for the practical deployment of automated patent drafting systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑