arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.16896cs.CYcs.AIcs.CLcs.LG
收藏

免费游玩:联合国贸易和发展会议开发自有开源检索增强生成大型语言模型应用的经验

Free to play: UN Trade and Development's experience with developing its own open-source Retrieval Augmented Generation Large Language Model application

UN Trade and Development(联合国贸易和发展会议)

Daniel Hopp

AI总结:

联合国贸发会议(UNCTAD)为应对专有AI方案的高成本与复杂性,自主开发了开源RAG LLM应用,并在GitHub和PyPI上公开了四个相关代码库,为国际组织利用生成式AI提供了灵活且低成本的实践路径。

摘要:

自2022年11月ChatGPT的Generative Pre-trained Transformer (GPT)-3.5模型向公众发布以来,生成式人工智能(AI),特别是大型语言模型(LLMs),在热度和关注度上呈爆发式增长。得益于这些通用模型的强大能力及其用自然语言交流的能力,它们在包括官方统计和国际组织工作在内的多个领域均具有应用价值。然而,面对如此新颖且看似复杂的技术,组织往往感觉生成式AI是被动发生在其身上的事物——可以被讨论却无法被理解,可以被评论却无法参与贡献。此外,专有解决方案的采用和运营成本既不确定又高昂,这对通常受预算限制的国际组织构成了障碍。面对这些挑战,联合国贸易和发展会议(UNCTAD)通过其全球危机应对小组(GCRG),探索并开发了自有的开源检索增强生成(RAG)LLM应用。RAG使LLMs能够了解该组织的领域和工作,从而提升其实用性。内部开发解决方案各有利弊:优点包括成本优势、灵活性以及促进机构知识积累;缺点则包括时间与技能投入、技能缺口,以及应用成熟度与性能方面的不足。为构建该应用而开发的三个库——用于文档处理和统计分析的nlp_pipeline、用于运行本地RAG LLM的local_rag_llm,以及用于用户界面的streamlit_rag——已连同Dockerfiles在PyPI和GitHub上公开发布。此外,还提供了第四个库local_llm_finetune,用于微调现有LLMs,微调后的模型可在该应用中使用。

英文摘要:

Generative artificial intelligence (AI), and in particular Large Language Models (LLMs), have exploded in popularity and attention since the release to the public of ChatGPT's Generative Pre-trained Transformer (GPT)-3.5 model in November of 2022. Due to the power of these general purpose models and their ability to communicate in natural language, they can be useful in a range of domains, including the work of official statistics and international organizations. However, with such a novel and seemingly complex technology, it can feel as if generative AI is something that happens to an organization, something that can be talked about but not understood, that can be commented on but not contributed to. Additionally, the costs of adoption and operation of proprietary solutions can be both uncertain and high, a barrier for often cost-constrained international organizations. In the face of these challenges, United Nations Trade and Development (UNCTAD), through its Global Crisis Response Group (GCRG), has explored and developed its own open-source Retrieval Augmented Generation (RAG) LLM application. RAG makes LLMs aware of and more useful for the organization's domain and work. Developing in-house solutions comes with pros and cons, with pros including cost, flexibility, and fostering institutional knowledge. Cons include time and skill investments and gaps and application polish and power. The three libraries developed to produce the app, nlp_pipeline for document processing and statistical analysis, local_rag_llm for running a local RAG LLM, and streamlit_rag for the user interface, are publicly available on PyPI and GitHub with Dockerfiles. A fourth library, local_llm_finetune, is also available for fine-tuning existing LLMs which can then be used in the application.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑