arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2610.22344cs.AIcs.CLcs.LG

MLExpert:面向自主机器学习工程的通用智能体模型

MLExpert: Towards a Generalist Agentic Model for Autonomous Machine Learning Engineering

Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);East China Normal University(华东师范大学)

Shangheng Du, Jinxin Shi, Shuaiyu Zhang, Yiming Wu, Junpeng Zhao, Shiyang Feng, Xin Li, Liang He, Xiangchao Yan, Bo Zhang

AI总结:

本研究提出35B混合专家智能体模型MLExpert,通过分层SFT、窗口交互RL等方法优化自主MLE,在MLE-Bench Lite等基准上大幅提升性能,且优化能力可泛化至多类任务。

摘要:

大型语言模型(LLMs)正从协助科学研究与工程开发拓展至自主开发和改进AI系统,推动AI for AI(AI4AI)成为递归自我改进(RSI)的实现路径。工作流驱动的机器学习工程(MLE)系统通过管理长周期实验的复杂编排,为该目标提供了可行路径;近期MLE系统采用模型导向交互,允许模型自主组织实验并基于执行反馈调整优化策略。然而,每项实验的反馈反映了多个前置决策,且一次长周期MLE运行包含大量此类高成本实验,因此训练需从长交互轨迹中筛选有用监督信号并从中间结果学习。我们提出一种用于自主长周期MLE优化的后训练方法,并将其应用于训练350亿参数的混合专家智能体模型MLExpert。我们设计Kaggle-MLE Factory以构建可执行任务和模型导向实验的交互框架;分层智能体监督微调(SFT)通过结果导向监督将通用工具使用与编码能力迁移至MLE;窗口交互强化学习(WIRL)将连续实验结果间的多轮决策视为一个执行窗口,并为其分配基于结果的共享奖励;异步收集与策略修正支持在轨迹结束前完成策略更新。在MLE-Bench Lite上,MLExpert将基础模型的平均奖牌率从37.9%提升至72.7%,达到与Kimi-K3、GLM-5.3等更大前沿模型相当的性能;进一步实验表明,MLExpert在NatureBench Lite、智能体支架优化及算法优化任务上均提升了性能,表明所学优化能力可泛化至其他任务。

英文摘要:

Large language models (LLMs) are expanding from assisting scientific research and engineering to autonomously developing and improving AI systems, advancing AI for AI (AI4AI) as a pathway toward recursive self-improvement (RSI). Workflow-driven machine learning engineering (MLE) systems provide a practical path toward this pursuit through complex orchestration that manages long-horizon experimentation, while recent MLE systems adopt model-directed interaction, allowing models to autonomously organize experiments and adapt optimization strategies based on execution feedback. However, feedback from each experiment reflects several preceding decisions, and a long MLE run contains many such costly experiments. Training must therefore select useful supervision from long interaction trajectories and learn from intermediate outcomes. We propose a post-training method for autonomous long-horizon MLE optimization and apply it to train MLExpert, a 35B Mixture-of-Experts agentic model. We design the Kaggle-MLE Factory to construct executable tasks and an interaction harness for model-directed experimentation. Hierarchical agentic SFT transfers general tool-use and coding capabilities to MLE through outcome-guided supervision. Windowed Interaction RL (WIRL) treats the multi-turn decisions between successive experiment results as an execution window and assigns it a shared outcome-based reward. Asynchronous collection and policy correction support policy updates before the trajectory ends. On MLE-Bench Lite, MLExpert improves the average medal rate of the base model from 37.9% to 72.7%, achieving performance comparable to larger frontier models such as Kimi-K3 and GLM-5.3. Further experiments show that MLExpert improves performance on NatureBench Lite, agent scaffold optimization, and algorithm optimization, suggesting that the learned optimization capability generalizes to other tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑