The automation of news analysis and summarization presents a promising solution to the challenge of processing and analyzing vast amounts of information prevalent in today's information society. Large Language Models (LLMs) have demonstrated the capability to transform vast amounts of textual data into concise and easily comprehensible summaries, offering an effective solution to the problem of information overload and providing users with a quick overview of relevant information. A particularly significant application of this technology lies in supply chain risk analysis. Companies must monitor the news about their suppliers and respond to incidents for several critical reasons, including compliance with laws and regulations, risk management, and maintaining supply chain resilience. This paper develops an automated news summarization system for supply chain risk analysis using LLMs. The proposed solution aggregates news from various sources, summarizes them using LLMs, and presents the condensed information to users in a clear and concise format. This approach enables companies to optimize their information processing and make informed decisions. Our study addresses two main research questions: (1) Are LLMs effective in automating news summarization, particularly in the context of supply chain risk analysis? (2) How effective are various LLMs in terms of readability, duplicate detection, and risk identification in their summarization quality? In this paper, we conducted an offline study using a range of publicly available LLMs at the time and complemented it with a user study focused on the top performing systems of the offline experiments to evaluate their effectiveness further. Our results demonstrate that LLMs, particularly Few-Shot GPT-4o mini, offer significant improvements in summary quality and risk identification.
University of Southern California Information Sciences Institute(南加州大学信息科学研究所);School of Computer Science, Wuhan University(武汉大学计算机学院);University of California, Davis(加州大学戴维斯分校)
NTS-CoT: Mitigating Hallucinations in LLM-based News Timeline Summarization with Chain-of-Thought Reasoning
Central South University(中南大学);Tsinghua University(清华大学);Nanjing University(南京大学);Suzhou Aerospace Information Research Institute(苏州空天信息研究院);McGill University(麦吉尔大学)
Evaluating the Evaluator: Summarization Metrics and LLM-Judges beyond English
HiTZ Center, University of the Basque Country (UPV/EHU)(巴斯克大学(UPV/EHU)HiTZ中心);University of Alicante (UA)(阿利坎特大学(UA));GOI Institute, Basque Summer University (UEU)(巴斯克夏季大学(UEU)GOI研究所)
An Evaluation of Large Language Models on Text Summarization Tasks Using Prompt Engineering Techniques
Information Systems Department, Faculty of Computers and Information, Assiut University(计算机与信息学院信息系统系,阿西乌特大学);Information Systems Department, Faculty of Computers and Artificial Intelligence, Beni-Suef University(计算机与人工智能学院信息系统系,班伊-苏夫大学)
Summarization of Films and Documentaries Based on Subtitles and Scripts
INESC ID Lisboa(里斯本高等工程学院信息与决策系统研究所);Instituto Universitário de Lisboa (ISCTE-IUL)(里斯本大学学院(ISCTE-IUL));Instituto Superior Técnico, Universidade de Lisboa(里斯本大学高等技术学院)
Text Summarization of Czech News Articles Using Named Entities
Czech Technical University in Prague(布拉格捷克理工大学)
Straka et al.(2018)的工作为捷克语中的摘要研究奠定了基础。他们发布了SumeCzech,一个大型的捷克新闻摘要数据集,并提出了几种基线方法。然而,从所取得的成果来看,显然还有很大的改进空间。在我们的工作中,我们专注于命名实体的捷克新闻文章的摘要的影响。首先,我们用命名实体注释SumeCzech。我们提出了一个新的度量ROUGE_NE,衡量重叠的命名实体之间的真实和生成的摘要,我们表明,它仍然是具有挑战性的摘要系统,以达到一个高的分数在it.We提出了一个提取的摘要方法命名实体密度,选择一个句子之间的最高比率的实体数量和句子的长度作为摘要的文章。实验结果表明,该方法在新闻文章选择第一句话的领域达到了接近坚实的基线的结果。此外,我们证明,所选的句子反映了简洁地确定谁,何时,何地,发生了什么事的报告的风格。我们建议,这样的摘要与呈现新闻文章的语音应用中的文章的第一句结合是有益的。提出了两种基于Seq2Seq结构的摘要方法。第一种方法使用文章的标记。第二种方法可以访问命名实体注释。实验表明,这两种方法都超过了Straka等人(2018)之前报道的最先进的结果,后者在SumeCzech的域外测试集上取得了略好的结果。
GlobeSumm: A Challenging Benchmark Towards Unifying Multi-lingual, Cross-lingual and Multi-document News Summarization
Harbin Institute of Technology(哈尔滨工业大学);The University of Hong Kong(香港大学);Peng Cheng Laboratory(鹏城实验室);Central South University(中南大学);Du Xiaoman Financial(度小满金融)