arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2402.03049cs.CLcs.AIcs.HCcs.IRcs.LG
收藏

EasyInstruct:一个面向大语言模型的易用指令处理框架

EasyInstruct: An Easy-to-use Instruction Processing Framework for Large Language Models

Zhejiang University(浙江大学)

Yixin Ou, Ningyu Zhang, Honghao Gui, Ziwen Xu, Shuofei Qiao, Yida Xue, Runnan Fang, Kangwei Liu, Lei Li, Zhen Bi, Guozhou Zheng, Huajun Chen

AI总结:

针对大语言模型指令处理领域缺乏统一开源框架的问题,提出模块化的EasyInstruct框架,整合指令生成、选择与提示模块并已开源,助力相关研究发展。

摘要:

近年来,指令微调受到越来越多的关注,已成为增强大语言模型(Large Language Models, LLMs)能力的关键技术。为构建高质量指令数据集,学界已提出诸多指令处理方法,力求在数据数量与数据质量间实现精妙平衡。然而,由于各类指令处理方法之间存在不一致性,目前社区尚无标准的开源指令处理实现框架,这阻碍了从业者的进一步开发与推进。为推动指令处理的研究与开发,我们提出EasyInstruct——一个面向LLMs的易用指令处理框架,它将指令生成、选择与提示词工程模块化,同时兼顾三者的组合与交互。EasyInstruct已在https://github.com/zjunlp/EasyInstruct公开发布并持续维护,同时配有在线演示应用与快速入门演示视频,以期吸引更多围绕指令数据与合成数据的研究。

英文摘要:

In recent years, instruction tuning has gained increasing attention and emerged as a crucial technique to enhance the capabilities of Large Language Models (LLMs). To construct high-quality instruction datasets, many instruction processing approaches have been proposed, aiming to achieve a delicate balance between data quantity and data quality. Nevertheless, due to inconsistencies that persist among various instruction processing methods, there is no standard open-source instruction processing implementation framework available for the community, which hinders practitioners from further developing and advancing. To facilitate instruction processing research and development, we present EasyInstruct, an easy-to-use instruction processing framework for LLMs, which modularizes instruction generation, selection, and prompting, while also considering their combination and interaction. EasyInstruct is publicly released and actively maintained at https://github.com/zjunlp/EasyInstruct, along with an online demo app and a demo video for quick-start, calling for broader research centered on instruction data and synthetic data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑