arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2512.02764cs.CL
收藏

PEFT-Factory:统一的参数高效微调自回归大语言模型

PEFT-Factory: Unified Parameter-Efficient Fine-Tuning of Autoregressive Large Language Models

Faculty of Information Technology, Brno University of Technology(布拉格技术学院,布拉格技术大学);Kempelen Institute of Intelligent Technologies(智能技术研究所)

Robert Belanec, Ivan Srba, Maria Bielikova

AI总结:

PEFT-Factory提供统一框架,整合多种参数高效微调方法和数据集,提升微调方法的可复现性和评估稳定性。

摘要:

PEFT-Factory通过提供统一框架,整合多种参数高效微调方法和数据集,提升了微调方法的可复现性和评估稳定性。

英文摘要:

Parameter-Efficient Fine-Tuning (PEFT) methods address the increasing size of Large Language Models (LLMs). Currently, many newly introduced PEFT methods are challenging to replicate, deploy, or compare with one another. To address this, we introduce PEFT-Factory, a unified framework for efficient fine-tuning LLMs using both off-the-shelf and custom PEFT methods. While its modular design supports extensibility, it natively provides a representative set of 19 PEFT methods, 27 classification and text generation datasets addressing 12 tasks, and both standard and PEFT-specific evaluation metrics. As a result, PEFT-Factory provides a ready-to-use, controlled, and stable environment, improving replicability and benchmarking of PEFT methods. PEFT-Factory is a downstream framework that originates from the popular LLaMA-Factory, and is publicly available at https://github.com/kinit-sk/PEFT-Factory.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑