arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2403.09131cs.CLcs.AI

ProSwitch:用于在专业与非专业回复间切换的知识引导指令微调

ProSwitch: Knowledge-Guided Instruction Tuning to Switch Between Professional and Non-Professional Responses

Zhejiang University of Science and Technology(浙江科技大学);Fudan University(复旦大学);Zhejiang University(浙江大学);The Chinese University of Hong Kong(香港中文大学);Tsinghua University(清华大学)

Chang Zong, Yuyan Chen, Weiming Lu, Jian Shao, Yongfeng Huang, Heng Chang, Yueting Zhuang

AI总结:

针对大语言模型在专业领域切换回复风格的研究不足问题,提出名为ProSwitch的知识引导指令微调方法,通过三阶段流程实现专业与非专业回复切换,效果优于通用及专用基线大模型。

摘要:

大语言模型(LLM)已在问答、受控文本生成等各类语言应用中展现出有效性,但针对其在专业领域中切换对立风格回复能力的研究仍有待深入。本研究提出一种名为ProSwitch的新方法,通过领域与风格知识的引导进行微调与评估,使语言模型能够在专业与非专业答案间切换。ProSwitch分为三个阶段:LLM增强准备阶段以收集领域知识与问答对,指令微调阶段利用多层级知识优化LLM,以及综合评估阶段以评估生成文本的风格区分度与基于参考的质量。将ProSwitch与通用及专用LLM进行对比分析表明,本方法在专业与非专业回复切换任务上优于基线模型。

英文摘要:

Large Language Models (LLMs) have demonstrated efficacy in various linguistic applications, including question answering and controlled text generation. However, studies into their ability to switch between opposite styles of responses in professional domains remain underexplored. This study introduces a novel approach, named ProSwitch, which enables a language model to switch between professional and non-professional answers, by tuning and evaluating through the guidance of domain and style knowledge. ProSwitch unfolds in three phases: LLM-augmented preparation to collect domain knowledge and QA pairs, instruction tuning to optimize LLMs with multiple levels of knowledge, and comprehensive evaluation to assess both style discrimination and reference-based quality of the generated text. Comparative analysis of ProSwitch against general and specialized LLMs reveals that our approach outperforms baselines in switching between professional and non-professional responses.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑