This systematic review undertakes a comprehensive analysis of current research on data-to-text generation, identifying gaps, challenges, and future directions within the field. Relevant literature in this field on datasets, evaluation metrics, application areas, multilingualism, language models, and hallucination mitigation methods is reviewed. Various methods for producing high-quality text are explored, addressing the challenge of hallucinations in data-to-text generation. These methods include re-ranking, traditional and neural pipeline architecture, planning architectures, data cleaning, controlled generation, and modification of models and training techniques. Their effectiveness and limitations are assessed, highlighting the need for universally applicable strategies to mitigate hallucinations. The review also examines the usage, popularity, and impact of datasets, alongside evaluation metrics, with an emphasis on both automatic and human assessment. Additionally, the evolution of data-to-text models, particularly the widespread adoption of transformer models, is discussed. Despite advancements in text quality, the review emphasizes the importance of research in low-resourced languages and the engineering of datasets in these languages to promote inclusivity. Finally, several application domains of data-to-text are highlighted, emphasizing their relevance in such domains. Overall, this review serves as a guiding framework for fostering innovation and advancing data-to-text generation.
Unsupervised Pre-training for Natural Language Generation: A Literature Review
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院)
What Are We Measuring in NLG? A Meta-Analysis of Evaluation Trends 2020-2025
Technische Universität Berlin(技术大学柏林);BIFOLD – Berlin Institute for the Foundations of Learning and Data(柏林学习与数据基础研究所);German Research Center for Artificial Intelligence (DFKI), Berlin(德国人工智能研究中心(DFKI),柏林);ANITI;University of Potsdam(波茨坦大学);CERTAIN
Systematic Task Exploration with LLMs: A Study in Citation Text Generation
Technical University of Darmstadt(达姆施塔特工业大学);IBM Research Europe - Ireland(IBM欧洲研究院爱尔兰分部);Hessian Center for AI (hessian.AI)(黑森人工智能中心);Ubiquitous Knowledge Processing Lab (UKP Lab)(普适知识处理实验室(UKP实验室))
From Instruction to Output: The Role of Prompting in Modern NLG
Faculty of Information Technology, Monash University(莫纳什大学信息科技学院);School of Computer, Data and Mathematical Sciences, Western Sydney University(西澳大学计算机、数据与数学科学学院);School of Computing, Macquarie University(麦考瑞大学计算学院)
Leveraging Large Language Models for NLG Evaluation: Advances and Challenges
Peking University(北京大学);Institute of Information Engineering, CAS(中国科学院信息工程研究所);AAII, FEIT, University of Technology Sydney(悉尼科技大学);UCLA(加利福尼亚大学洛杉矶分校);The Open University of China(国家开放大学);Beihang University(北京航空航天大学)
Can large language models replace humans in the systematic review process? Evaluating GPT-4's efficacy in screening and extracting data from peer-reviewed and grey literature in multiple languages
Trinity Centre for Global Health(三一全球健康中心);School of Psychology(心理学院);Trinity College Dublin(都柏林圣三一学院);University of York(约克大学)
A Survey of Knowledge Enhanced Pre-trained Language Models
Beijing Institute of Technology(北京理工大学);Beijing University of Posts and Telecommunications(北京邮电大学);Tsinghua University(清华大学);Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳))
Enhancing Systematic Reviews with Large Language Models: Using GPT-4 and Kimi
Pearson(培生集团);Measurement Incoporated(测量公司);British Columbia College of Nurses and Midwives(不列颠哥伦比亚省护士与助产士学院);University of Illinois Springfield(伊利诺伊大学斯普林菲尔德分校);HSHS Saint John’s Hospital(HSHS圣约翰医院)
本研究评估了 GPT-4 和 Kimi 两种大型语言模型在系统评价中的表现,发现其性能受数据量和问题复杂性的影响。
Leveraging LLMs for Title and Abstract Screening for Systematic Review: A Cost-Effective Dynamic Few-Shot Learning Approach
Duke University(杜克大学);National University of Singapore(新加坡国立大学);Nanyang Technological University(南洋理工大学);Duke University School of Medicine(杜克大学医学院);Duke Clinical Research Institute(杜克临床研究所)
Machine Learning Information Retrieval and Summarisation to Support Systematic Review on Outcomes Based Contracting
University of Warwick(华威大学);Alan Turing Institute for Data Science and AI(艾伦·图灵数据科学与人工智能研究所);Cranfield University(克兰菲尔德大学);Government Outcomes Lab(政府成果实验室);Blavatnik School of Government(布拉瓦尼克政府学院);University of Oxford(牛津大学)