Chinese-Vicuna：基于Llama的中文指令遵循模型
Chinese-Vicuna: A Chinese Instruction-following Llama-based Model
AI总结：
该研究通过LoRA微调LLaMA架构开发开源中文指令遵循模型Chinese-Vicuna，整合混合数据集与4位量化技术，实现消费级GPU部署，在多任务中表现优异，为中文大语言模型应用提供通用基础。
摘要：
Chinese-Vicuna是一款开源、资源高效的语言模型，旨在通过低秩适配（LoRA）微调Meta的LLaMA架构，填补中文指令遵循能力的空白。该模型针对低资源环境，可在消费级GPU（如用于7B模型的RTX-2080Ti）上实现高性价比部署，并支持医疗、法律等领域的特定适配。通过整合混合数据集（BELLE和Guanaco）与4位量化（QLoRA），模型在翻译、代码生成和特定领域问答等任务中表现出竞争力。该项目提供模型转换、CPU推理和多轮对话界面的综合工具包，强调对研究人员和开发者的可访问性。评估显示其在医疗任务、多轮对话连贯性和实时法律更新方面表现出色。Chinese-Vicuna的模块化设计、开源生态系统和社区驱动的增强使其成为中文大语言模型应用的通用基础。
英文摘要：
Chinese-Vicuna is an open-source, resource-efficient language model designed to bridge the gap in Chinese instruction-following capabilities by fine-tuning Meta's LLaMA architecture using Low-Rank Adaptation (LoRA). Targeting low-resource environments, it enables cost-effective deployment on consumer GPUs (e.g., RTX-2080Ti for 7B models) and supports domain-specific adaptation in fields like healthcare and law. By integrating hybrid datasets (BELLE and Guanaco) and 4-bit quantization (QLoRA), the model achieves competitive performance in tasks such as translation, code generation, and domain-specific Q\&A. The project provides a comprehensive toolkit for model conversion, CPU inference, and multi-turn dialogue interfaces, emphasizing accessibility for researchers and developers. Evaluations indicate competitive performance across medical tasks, multi-turn dialogue coherence, and real-time legal updates. Chinese-Vicuna's modular design, open-source ecosystem, and community-driven enhancements position it as a versatile foundation for Chinese LLM applications.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
