arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.08496cs.CLcs.AIcs.LG
收藏

数据到文本自然语言生成的系统综述

A Systematic Review of Data-to-Text NLG

ADAPT Research Centre(ADAPT研究中心);Dublin City University(都柏林城市大学);Federal University of Minas Gerais (UFMG)(米纳斯吉拉斯联邦大学(UFMG))

Chinonso Cynthia Osuji, Thiago Castro Ferreira, Brian Davis

AI总结:

本文系统综述了数据到文本生成领域的研究现状,重点分析了幻觉缓解方法、数据集与评估指标、模型演进及低资源语言挑战,为该领域未来发展提供了指导框架。

摘要:

本系统综述对当前数据到文本生成的研究进行了全面分析,识别了该领域内的研究空白、挑战和未来方向。本文回顾了该领域中关于数据集、评估指标、应用领域、多语言、语言模型以及幻觉缓解方法的相关文献。文中探讨了多种用于生成高质量文本的方法,以应对数据到文本生成中的幻觉挑战。这些方法包括重排序、传统与神经流水线架构、规划架构、数据清洗、受控生成,以及对模型和训练技术的修改。本文评估了这些方法的有效性和局限性,强调了需要具有普遍适用性的策略来缓解幻觉问题。综述还考察了数据集的使用情况、流行度和影响力,以及评估指标,重点关注自动评估和人工评估。此外,本文讨论了数据到文本模型的演变,特别是Transformer模型的广泛采用。尽管文本质量有所提升,综述仍强调了对低资源语言研究以及在这些语言中构建数据集以促进包容性的重要性。最后,本文突出了数据到文本的若干应用领域,强调了它们在这些领域中的相关性。总体而言,本综述为促进创新和推进数据到文本生成提供了一个指导性框架。

英文摘要:

This systematic review undertakes a comprehensive analysis of current research on data-to-text generation, identifying gaps, challenges, and future directions within the field. Relevant literature in this field on datasets, evaluation metrics, application areas, multilingualism, language models, and hallucination mitigation methods is reviewed. Various methods for producing high-quality text are explored, addressing the challenge of hallucinations in data-to-text generation. These methods include re-ranking, traditional and neural pipeline architecture, planning architectures, data cleaning, controlled generation, and modification of models and training techniques. Their effectiveness and limitations are assessed, highlighting the need for universally applicable strategies to mitigate hallucinations. The review also examines the usage, popularity, and impact of datasets, alongside evaluation metrics, with an emphasis on both automatic and human assessment. Additionally, the evolution of data-to-text models, particularly the widespread adoption of transformer models, is discussed. Despite advancements in text quality, the review emphasizes the importance of research in low-resourced languages and the engineering of datasets in these languages to promote inclusivity. Finally, several application domains of data-to-text are highlighted, emphasizing their relevance in such domains. Overall, this review serves as a guiding framework for fostering innovation and advancing data-to-text generation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑