arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.06798cs.HCcs.AIcs.CY
收藏

“如果是AI写的,就不可能正确”:论律师对感知为LLM生成与人类撰写的文档的偏好

It Cannot Be Right If It Was Written by AI: On Lawyers' Preferences of Documents Perceived as Authored by an LLM vs a Human

Faculty of Law, Masaryk University(马萨里克大学法学院);School of Computer Science, Carnegie Mellon University(卡内基梅隆大学计算机学院)

Jakub Harasta, Tereza Novotná, Jaromir Savelka

AI总结:

本研究通过对75名律师和法学生的实验发现,法律从业者明显更偏好感知为人类撰写的法律文档,但多数人仍预期未来文档将自动生成,为法律领域负责任地采用生成式AI提供参考。

摘要:

大语言模型(Large Language Models, LLMs)让某些类型的法律文档有望实现自动生成。这一技术在简化法律流程、降低法律服务成本、大幅提升司法可及性方面具备巨大潜力。尽管众多研究者专注于提出并评估支撑法律领域任务的基于LLM的应用,但针对法律专业人士在认为内容由LLM生成时的感知态度的研究仍明显匮乏。然而,这是一个关键问题,因为过度依赖或毫无根据的怀疑都可能影响此类文档能否产生恰当的法律后果。本研究是对当前向成熟生成式AI系统转型过程的必要分析。具体而言,我们考察了律师与法学生(样本量n=75)对法律文档的感知是否会因假定的来源(人工撰写 vs AI生成)而存在差异。参与者围绕文档的正确性和语言质量对其进行评估。我们的分析显示,相较于被认为由AI生成的文档,参与者明显更偏好感知为人工撰写的文档。与此同时,大多数参与者都预期未来会实现文档的自动生成。法律从业者、政策制定者与立法者可借助这些研究发现,负责任地推行和采用法律文档生成技术,并推动围绕法律流程应如何更新以适配最新技术发展的必要讨论。

英文摘要:

Large Language Models (LLMs) enable a future in which certain types of legal documents may be generated automatically. This has a great potential to streamline legal processes, lower the cost of legal services, and dramatically increase access to justice. While many researchers focus on proposing and evaluating LLM-based applications supporting tasks in the legal domain, there is a notable lack of investigations into how legal professionals perceive content if they believe an LLM has generated it. Yet, this is a critical point as over-reliance or unfounded scepticism may influence whether such documents bring about appropriate legal consequences. This study is the necessary analysis of the ongoing transition towards mature generative AI systems. Specifically, we examined whether the perception of legal documents' by lawyers and law students (n=75) varies based on their assumed origin (human-crafted vs AI-generated). The participants evaluated the documents, focusing on their correctness and language quality. Our analysis revealed a clear preference for documents perceived as crafted by a human over those believed to be generated by AI. At the same time, most participants expect the future in which documents will be generated automatically. These findings could be leveraged by legal practitioners, policymakers, and legislators to implement and adopt legal document generation technology responsibly and to fuel the necessary discussions on how legal processes should be updated to reflect recent technological developments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑