MaD-RSI: Model-as-Data for Recursive Self-Improvement of Agent Harnesses
Beijing Institute of Technology(北京理工大学);Tsinghua University(清华大学);Chengdu Institute of Computer Applications, Chinese Academy of Sciences(中国科学院成都计算机应用研究所);University of Chinese Academy of Sciences(中国科学院大学);Beijing University of Technology(北京工业大学);Yangtze Delta Region Institute of Tsinghua University, Zhejiang(浙江清华长三角研究院)
Recursive self-improvement (RSI) of agent harnesses has emerged as an effective approach to enhancing the capabilities of large language model (LLM) agents. By searching the harness space for a specific LLM on a given dataset, RSI can discover a harness tailored to the capabilities and behavioral characteristics of that model. However, such optimization often creates a strong coupling between the learned harness and its target LLM, limiting generalization across models and requiring substantial computational resources to adapt to new LLMs. Moreover, existing RSI methods typically optimize a harness using feedback from a single model and evaluate its generalization to other models only after training. This paradigm treats model differences primarily as a criterion for evaluating generalization rather than as valuable evidence for optimization. In this paper, we introduce a new perspective that treats models as data and places the harness at the center of optimization. Building on this perspective, we propose \textsc{MaD-RSI}, a framework that directly optimizes a shared harness across multiple heterogeneous LLMs by incorporating their diverse failure trajectories into the training process. Rather than assessing model differences only after optimization, \textsc{MaD-RSI} leverages these differences as training evidence to guide the self-improvement of a shared harness. Furthermore, we introduce a new evaluation framework with two complementary metrics designed to assess the effectiveness of harness optimization across models. Experiments across multiple datasets and LLMs demonstrate that \textsc{MaD-RSI} improves generalization over existing approaches while reducing training costs.
Harness Handbook: Making Evolving Agent Harnesses Readable,Navigable, and Editable
Tencent(腾讯);Indiana University(印第安纳大学);University of Maryland, College Park(马里兰大学帕克分校);University of Georgia(佐治亚大学);National University of Singapore(新加坡国立大学)
Distilling Lightweight Language Models for C/C++ Vulnerabilities
School of Computer Science and Technology(计算机科学与技术学院);Beijing Institute of Technology(北京理工大学);School of Cyberspace Science and Technology(网络空间科学与技术学院);School of Computer Science(计算机科学学院);University of Auckland(奥克兰大学)
VibeTraining-Bench: Data-Trainer-Harness Co-Design for Iterative System Improvement
Zhejiang University(浙江大学);Westlake University(西湖大学);Alibaba Group(阿里巴巴集团);South China University of Technology(华南理工大学);The Chinese University of Hong Kong(香港中文大学)
AgroGPT: Efficient Agricultural Vision-Language Model with Expert Tuning
Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);Georgia Institute of Technology(佐治亚理工学院);Johns Hopkins University(约翰斯·霍普金斯大学)
Zhejiang University(浙江大学);Alibaba Group(阿里巴巴集团);City University of Hong Kong(香港城市大学);The Hong Kong University of Science and Technology(香港科技大学);University of Michigan(密歇根大学)