arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2604.09418cs.CLcs.LG

自动化指令修订(AIR):一种针对大语言模型任务适应策略的结构化比较

Automated Instruction Revision (AIR): A Structured Comparison of Task Adaptation Strategies for LLM

Eleks Ltd.(Eleks有限公司);Ukrainian Catholic University(乌克兰天主教大学)

Solomiia Bilyk, Volodymyr Getmanskyi, Taras Firman

AI总结:

本文研究了基于规则归纳的自动化指令修订(AIR)方法,用于在有限任务特定示例下适应大语言模型。通过比较多种适应策略在不同基准测试中的表现,发现任务依赖性显著,无单一方法在所有情况下占优。

摘要:

本文研究了基于规则归纳的自动化指令修订(AIR)方法,用于在有限任务特定示例下适应大语言模型。通过比较多种适应策略在不同基准测试中的表现,发现任务依赖性显著,无单一方法在所有情况下占优。

英文摘要:

This paper studies Automated Instruction Revision (AIR), a rule-induction-based method for adapting large language models (LLMs) to downstream tasks using limited task-specific examples. We position AIR within the broader landscape of adaptation strategies, including prompt optimization, retrieval-based methods, and fine-tuning. We then compare these approaches across a diverse benchmark suite designed to stress different task requirements, such as knowledge injection, structured extraction, label remapping, and logical reasoning. The paper argues that adaptation performance is strongly task-dependent: no single method dominates across all settings. Across five benchmarks, AIR was strongest or near-best on label-remapping classification, while KNN retrieval performed best on closed-book QA, and fine-tuning dominated structured extraction and event-order reasoning. AIR is most promising when task behavior can be captured by compact, interpretable instruction rules, while retrieval and fine-tuning remain stronger in tasks dominated by source-specific knowledge or dataset-specific annotation regularities.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑