arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.02584cs.CLcs.AIcs.IR
收藏

利用大语言模型的力量:面向高质量方面级摘要的微调方法

Leveraging the Power of LLMs: A Fine-Tuning Approach for High-Quality Aspect-Based Summarization

Computer Science and Engineering Department, IIT Kharagpur(印度理工学院卡拉格普尔分校计算机科学与工程系);Emergence AI(Emergence AI公司)

Ankan Mullick, Sombit Bose, Rounak Saha, Ayan Kumar Bhowmick, Aditya Vempaty, Pawan Goyal, Niloy Ganguly, Prasenjit Dey, Ravi Kokku

AI总结:

本文研究通过微调Llama2、Mistral、Gemma和Aya等开源大语言模型来提升方面级摘要质量,并建立评估框架验证其优于现有方法和未微调模型。

摘要:

数字信息量的持续增长要求用户采用高效方法从冗长文档中提取关键见解。方面级摘要提供了一种有针对性的方法,生成聚焦于文档中特定方面的摘要。尽管方面级摘要研究已取得进展,但人们仍在不断追求模型性能的提升。鉴于大语言模型(LLMs)已展现出革新自然语言处理中多种任务的潜力,尤其是在摘要问题上,本文探索了针对方面级摘要任务微调LLMs的潜力。我们评估了在公开可用的领域特定方面级摘要数据集上微调开源基础LLMs(包括Llama2、Mistral、Gemma和Aya)的影响。我们假设这种方法将使这些模型能够有效识别并提取与方面相关的信息,从而产生优于当前最先进方法的方面级摘要。我们建立了一个全面的评估框架,将微调后的LLMs与竞争的方面级摘要方法以及微调LLMs的未微调对应版本进行性能比较。我们的工作通过证明微调LLMs在生成高质量方面级摘要方面的有效性,为方面级摘要领域做出了贡献。此外,它为在各种自然语言处理领域中进一步探索使用LLMs进行有针对性的信息提取任务开辟了道路。

英文摘要:

The ever-increasing volume of digital information necessitates efficient methods for users to extract key insights from lengthy documents. Aspect-based summarization offers a targeted approach, generating summaries focused on specific aspects within a document. Despite advancements in aspect-based summarization research, there is a continuous quest for improved model performance. Given that large language models (LLMs) have demonstrated the potential to revolutionize diverse tasks within natural language processing, particularly in the problem of summarization, this paper explores the potential of fine-tuning LLMs for the aspect-based summarization task. We evaluate the impact of fine-tuning open-source foundation LLMs, including Llama2, Mistral, Gemma and Aya, on a publicly available domain-specific aspect based summary dataset. We hypothesize that this approach will enable these models to effectively identify and extract aspect-related information, leading to superior quality aspect-based summaries compared to the state-of-the-art. We establish a comprehensive evaluation framework to compare the performance of fine-tuned LLMs against competing aspect-based summarization methods and vanilla counterparts of the fine-tuned LLMs. Our work contributes to the field of aspect-based summarization by demonstrating the efficacy of fine-tuning LLMs for generating high-quality aspect-based summaries. Furthermore, it opens doors for further exploration of using LLMs for targeted information extraction tasks across various NLP domains.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑