arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2510.26683cs.CLcs.AI
收藏

Evontree:基于本体规则的大型语言模型自进化

Evontree: Ontology Rule-Guided Self-Evolution of Large Language Models

Zhejiang University(浙江大学);University of Electronic Science and Technology of China(电子科技大学);Ant Group(蚂蚁集团)

Mingchen Tu, Zhiqiang Liu, Juan Li, Liangyurui Liu, Junjie Wang, Lei Liang, Wen Zhang

AI总结:

本文提出Evontree方法,通过提取领域本体知识、检测不一致性和自蒸馏微调,提升低资源专业领域LLM的自进化能力,实验表明其在医疗问答基准上准确率提升达3.7%。

摘要:

尽管大型语言模型(LLMs)在通用领域表现优异,但在医疗和法律等专业领域,幻觉问题带来显著风险,且现有微调方法依赖大量专业数据,难以获取。本文提出Evontree方法,通过提取领域本体知识、利用两个核心本体规则检测知识不一致,并通过自蒸馏微调强化知识缺口,实现在低资源专业领域的LLM自进化。在医疗问答基准上,使用Llama3-8B-Instruct和Med42-V2进行评估,结果表明Evontree优于基线模型和强基线,准确率提升达3.7%。详细消融研究进一步验证了方法的鲁棒性。

英文摘要:

Although Large Language Models (LLMs) perform exceptionally well in general domains, the problem of hallucinations poses significant risks in specialized fields such as healthcare and law, where high interpretability is essential. Existing fine-tuning methods depend heavily on large-scale professional datasets, which are often hard to obtain due to the privacy regulations. Moreover, existing self-evolution methods are primarily designed for general domains, which may struggle to adapt to knowledge-intensive domains due to the lack of knowledge constraints. In this paper, we propose an ontology rule guided method Evontree to enable self-evolution of LLMs in low-resource specialized domains. Specifically, Evontree first extracts domain ontology knowledge from raw models, then detects knowledge inconsistencies using two core ontology rules, and finally reinforces gap knowledge into model via self-distilled fine-tuning. Extensive evaluations on medical QA benchmarks using Llama3-8B-Instruct and Med42-V2 demonstrate the effectiveness of Evontree, which outperforms both the base models and strong baselines, achieving up to a 3.7\% improvement in accuracy. Detailed ablation studies further validate the robustness of our approach.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑