从二元 groundedness 到支持关系:迈向以读者为中心的 AI 输出理解分类体系
From Binary Groundedness to Support Relations: Towards a Reader-Centred Taxonomy for Comprehension of AI Output
AI总结:
本文提出以读者为中心的 groundedness 分类体系,旨在通过支持关系提升 AI 输出理解的透明度和可解释性。
摘要:
生成式 AI 工具常通过检索增强生成来回答问题。当前 groundedness 和幻觉评估大多将答案与源文档的关系视为二元(支持或不支持)。然而,这掩盖了模型在重构证据为答案时所进行的语法和解释性操作。本文提出开发一个以读者为中心的 groundedness 分类体系,作为生成陈述与源文档之间的支持关系集合。我们解释了如何从语言学和语言哲学研究中综合此类分类,并通过基准测试和人工标注协议进行评估。此类框架将使接口能够不仅告知声明是否被支持,还能说明如何被支持。
英文摘要:
Generative AI tools often answer questions using source documents, e.g., through retrieval augmented generation. Current groundedness and hallucination evaluations largely frame the relationship between an answer and its sources as binary (the answer is either supported or unsupported). However, this obscures both the syntactic moves (e.g., direct quotation vs. paraphrase) and the interpretive moves (e.g., induction vs. deduction) performed when models reformulate evidence into an answer. This limits both benchmarking and user-facing provenance interfaces. We propose the development of a reader-centred taxonomy of grounding as a set of support relations between generated statements and source documents. We explain how this might be synthesised from prior research in linguistics and philosophy of language, and evaluated through a benchmark and human annotation protocol. Such a framework would enable interfaces that communicate not just whether a claim is grounded, but how.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。