发表机构
King’s College London（伦敦国王学院）
机构由 AI 辅助整理，请以论文原文为准。AI 中文总结
该研究定义关键点分析（KPA）为结构化预测问题，诊断现有KPA基准缺陷，构建人机协同标注的结构感知基准并发布相关资源，为KPA研究提供支持
AI 中文摘要
关键点分析（KPA）旨在识别一组简洁的关键点，用于总结一系列论点及其流行度。我们认为KPA本质上是一个结构化预测问题，需要恢复语义分组、生成代表性关键点、确保覆盖范围并估计流行度。在该框架下，我们发现现有KPA基准存在分组质量差、冗余度高、覆盖不足及论点-关键点映射不当等问题，导致基于参考的评估中出现上限违反和选择失败。为支持真正KPA的未来研究，我们引入了一种通过人机协同重新标注构建的结构感知、分布敏感型基准。人类与大语言模型（LLM）的评估一致表明，与现有标注相比，所得结构能产生更连贯的分组、更高质量的关键点、更好的覆盖范围及更可靠的流行度估计。我们还发布了多项标注资源，以支持KPA评估、论点-关键点匹配、可解释KPA及LLM作为评判者方法的研究，并概述了真正KPA的研究议程。
英文摘要
Key Point Analysis (KPA) aims to identify a concise set of key points that summarize a collection of arguments together with their prevalence. We argue that KPA is fundamentally a structured prediction problem that requires recovering semantic groupings, generating representative key points, ensuring coverage, and estimating prevalence. Under this formulation, we show that existing KPA benchmarks suffer from limitations in grouping quality, redundancy, coverage, and argument-key point mappings, causing ceiling violation and selection failure in reference-based evaluation. To support future research on true KPA, we introduce a structure-aware, distribution-sensitive benchmark built via a human-in-the-loop re-annotation. Human and LLM evaluations consistently show that the resulting structures yield more coherent groupings, higher-quality key points, better coverage, and more reliable prevalence estimates than existing annotations. We further release several annotation resources to support research on KPA evaluation, argument-key point matching, explainable KPA, and LLM-as-a-judge methodologies, and outline a research agenda for true KPA.
