arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2411.16732cs.CLcs.IR
收藏

Multi-Reranker:在FinanceRAG挑战赛中最大化检索增强生成的性能

Multi-Reranker: Maximizing performance of retrieval-augmented generation in the FinanceRAG challenge

Financial Security Institute(金融安全研究院)

Joohyun Lee, Minji Roh

AI总结:

本文针对ACM-ICAIF '24 FinanceRAG竞赛开发金融专用RAG系统,通过检索前消融研究、多重排序模型及长上下文管理方法提升性能,获挑战赛第2名,为金融领域LLM应用提供参考。

摘要:

随着大型语言模型(LLMs)越来越多地解决特定领域问题,它们在金融领域的应用迅速扩展。分析财务报表、披露文件及相关文档等既高价值又耗时的任务,如今正通过LLMs得到有效处理。本文详细介绍了为ACM-ICAIF '24 FinanceRAG竞赛开发的高性能、金融专用检索增强生成(RAG)系统。我们通过检索前阶段对查询扩展和语料库优化的消融研究来优化性能。为提高检索准确性,我们采用了多个重排序模型。值得注意的是,我们在生成阶段引入了一种高效的长上下文管理方法,在不牺牲性能的情况下显著提升了响应质量。最终我们在FinanceRAG挑战赛中获得第2名。我们的主要贡献包括:(1)检索前的消融分析;(2)改进的检索算法;(3)长上下文管理的新方法。这项工作展示了LLMs在有效处理和分析复杂金融数据以生成准确且有价值的见解方面的潜力。源代码和更多细节可在https://github.com/cv-lee/FinanceRAG获取。

英文摘要:

As Large Language Models (LLMs) increasingly address domain-specific problems, their application in the financial sector has expanded rapidly. Tasks that are both highly valuable and time-consuming, such as analyzing financial statements, disclosures, and related documents, are now being effectively tackled using LLMs. This paper details the development of a high-performance, finance-specific Retrieval-Augmented Generation (RAG) system for the ACM-ICAIF '24 FinanceRAG competition. We optimized performance through ablation studies on query expansion and corpus refinement during the pre-retrieval phase. To enhance retrieval accuracy, we employed multiple reranker models. Notably, we introduced an efficient method for managing long context sizes during the generation phase, significantly improving response quality without sacrificing performance. We ultimately achieve 2nd place in the FinanceRAG Challenge. Our key contributions include: (1) pre-retrieval ablation analysis, (2) an enhanced retrieval algorithm, and (3) a novel approach for long-context management. This work demonstrates the potential of LLMs in effectively processing and analyzing complex financial data to generate accurate and valuable insights. The source code and further details are available at https://github.com/cv-lee/FinanceRAG.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑