arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2508.04073cs.CLcs.LG
收藏

提升大型语言模型(LLM)能力的高效策略

Efficient Strategy for Improving Large Language Model (LLM) Capabilities

Universidad Nacional de Colombia(哥伦比亚国立大学)

Julián Camilo Velandia Gutiérrez

AI总结:

本文提出从基础模型出发,结合数据处理、训练策略与架构调整,在资源受限环境下提升LLM效率,并通过受控实验和对比测试验证策略有效性。

摘要:

大型语言模型(LLM)已成为人工智能和自然语言处理领域的里程碑。然而,其大规模部署仍受限于对大量计算资源的需求。本工作提出从基础模型出发,探索并组合数据处理与精细数据选择技术、训练策略以及架构调整,以提高LLM在资源受限环境和限定知识库内的效率。方法论包括定义构建可靠数据集的标准,开展不同配置下的受控实验,并从能力、多功能性、响应时间和安全性方面系统评估所得变体。最后,进行了对比测试以衡量所开发变体的性能并验证所提策略的有效性。本工作基于系统与计算机工程硕士论文《提升大型语言模型(LLM)能力的高效策略》。

英文摘要:

Large Language Models (LLMs) have become a milestone in the field of artificial intelligence and natural language processing. However, their large-scale deployment remains constrained by the need for significant computational resources. This work proposes starting from a base model to explore and combine data processing and careful data selection techniques, training strategies, and architectural adjustments to improve the efficiency of LLMs in resource-constrained environments and within a delimited knowledge base. The methodological approach included defining criteria for building reliable datasets, conducting controlled experiments with different configurations, and systematically evaluating the resulting variants in terms of capability, versatility, response time, and safety. Finally, comparative tests were conducted to measure the performance of the developed variants and to validate the effectiveness of the proposed strategies. This work is based on the master's thesis in Systems and Computer Engineering titled "Efficient Strategy for Improving the Capabilities of Large Language Models (LLMs)".

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑