Agentic large language models (LLMs) have become prominent for autonomously interacting with external environments and performing multi-step reasoning tasks. Most approaches leverage these capabilities via in-context learning with few-shot prompts, but this often results in lengthy inputs and higher computational costs. Agent fine-tuning offers an alternative by enabling LLMs to internalize procedural reasoning and domain-specific knowledge through training on relevant data and demonstration trajectories. While prior studies have focused on general domains, their effectiveness in specialized technical microdomains remains unclear. This paper explores agent fine-tuning for domain adaptation within Hitachi's JP1 middleware, a microdomain for specialized IT operations. We fine-tuned LLMs using JP1-specific datasets derived from domain manuals and distilled reasoning trajectories generated by LLMs themselves, enhancing decision making accuracy and search efficiency. During inference, we used an agentic prompt with retrieval-augmented generation and introduced a context-answer extractor to improve information relevance. On JP1 certification exam questions, our method achieved a 14% performance improvement over the base model, demonstrating the potential of agent fine-tuning for domain-specific reasoning in complex microdomains.
Quantification of Large Language Model Distillation
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);Peking University(北京大学);SUSTech(南方科技大学);SUAT;Leibowitz AI;UNSW Sydney(新南威尔士大学悉尼分校)
Language-Aware Distillation for Multilingual Instruction-Following Speech LLMs with ASR-Only Supervision
College of Computing and Data Science(计算与数据科学学院);Nanyang Technological University(南洋理工大学);AI Singapore(AI新加坡);National University of Singapore(新加坡国立大学);Institute for Infocomm Research (I$^2$R)(信息通信研究所);A$^{*}$STAR(A*星)
Boosting LLM Translation Skills without General Ability Loss via Rationale Distillation
School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Department of Computer Science, University of Illinois at Chicago(芝加哥大学计算机科学系)
Department of Computer Science(计算机科学系);Engineering, Shanghai Jiao Tong University(上海交通大学工程学院);Shanghai Innovation Institute(上海创新研究院);Large Language Department, Tencent(腾讯大语言部门)
Enhancing Multilingual Capabilities of Large Language Models through Self-Distillation from Resource-Rich Languages
Department of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术系);Institute for AI Industry Research (AIR), Tsinghua University(清华大学人工智能产业研究院(AIR))
Summarize-Exemplify-Reflect: Data-driven Insight Distillation Empowers LLMs for Few-shot Tabular Classification
ETH Zürich(苏黎世联邦理工学院);University of Copenhagen(哥本哈根大学);University of Science and Technology of China(中国科学技术大学);University of Amsterdam(阿姆斯特丹大学);East China Normal University(东华大学)
A Survey on Knowledge Distillation of Large Language Models
University of Maryland(马里兰大学);Microsoft(微软公司);University of Technology Sydney(悉尼科技大学);Peking University(北京大学);The University of Sydney(悉尼大学);The University of Hong Kong(香港大学)
Chain-based Distillation for Effective Initialization of Variable-Sized Small Language Models
School of Computer Science and Engineering, Southeast University, Nanjing, China(东南大学计算机科学与工程学院,南京,中国);Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications (Southeast University), Ministry of Education, China(新一代人工智能技术及其交叉应用重点实验室(东南大学),教育部,中国)
Enhancing Knowledge Distillation of Large Language Models through Efficient Multi-Modal Distribution Alignment
School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Wuhan AI Research(武汉人工智能研究院);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)