面向可复现性、比较评估与方法创新的对话摘要方法系统探索，以推进自然语言处理中的抽象式摘要研究
Systematic Exploration of Dialogue Summarization Approaches for Reproducibility, Comparative Assessment, and Methodological Innovations for Advancing Natural Language Processing in Abstractive Summarization
AI总结：
本文系统复现并比较了基于AMI数据集的HMNet和多种PGN对话摘要模型，通过人工评估分析其摘要质量与信息量，揭示了原始研究与复现结果之间的差异，为抽象式摘要的可复现性研究提供方法学参考。
摘要：
科学研究中的可复现性，尤其是在自然语言处理（NLP）领域，对于验证和核实实验结果的稳健性至关重要。本文深入探讨对话摘要模型的复现与评估，重点关注原始研究与我们的复现工作之间观察到的差异。对话摘要是NLP的一个关键方面，旨在将会话内容压缩为简洁且信息丰富的摘要，从而有助于高效的信息检索和决策过程。我们的研究使用AMI（Augmented Multi-party Interaction，增强多方交互）数据集对多个对话摘要模型进行了全面考察。所评估的模型包括Hierarchical Memory Networks（HMNet，层次记忆网络）以及Pointer-Generator Networks（PGN，指针生成网络）的多个版本，即PGN(DKE)、PGN(DRD)、PGN(DTS)和PGN(DALL)。主要目标是通过人工评估来评价这些模型所生成摘要的信息量和质量，而人工评估这一方法会在评估过程中引入主观性和变异性。分析从Dataset 1开始，其样本标准差为0.656，表明数据点围绕均值呈中等程度的离散分布。
英文摘要：
Reproducibility in scientific research, particularly within the realm of natural language processing (NLP), is essential for validating and verifying the robustness of experimental findings. This paper delves into the reproduction and evaluation of dialogue summarization models, focusing specifically on the discrepancies observed between original studies and our reproduction efforts. Dialogue summarization is a critical aspect of NLP, aiming to condense conversational content into concise and informative summaries, thus aiding in efficient information retrieval and decision-making processes. Our research involved a thorough examination of several dialogue summarization models using the AMI (Augmented Multi-party Interaction) dataset. The models assessed include Hierarchical Memory Networks (HMNet) and various versions of Pointer-Generator Networks (PGN), namely PGN(DKE), PGN(DRD), PGN(DTS), and PGN(DALL). The primary objective was to evaluate the informativeness and quality of the summaries generated by these models through human assessment, a method that introduces subjectivity and variability in the evaluation process. The analysis began with Dataset 1, where the sample standard deviation of 0.656 indicated a moderate dispersion of data points around the mean.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
