arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2408.14033cs.AIcs.CLcs.LG
收藏

MLR-Copilot:基于大语言模型智能体的自主机器学习研究

MLR-Copilot: Autonomous Machine Learning Research based on Large Language Models Agents

University of Texas at Dallas(德克萨斯大学达拉斯分校);UIUC(伊利诺伊大学)

Ruochen Li, Teerth Patel, Qingyun Wang, Xinya Du

AI总结:

本文提出MLR-COPILOT框架,借助大语言模型智能体实现自主机器学习研究,包含想法生成、实验实现和代码执行三阶段,在五个任务上的评估显示其能提升研究效率并促进创新。

摘要:

自主机器学习研究近期受到广泛关注。我们提出MLR-COPILOT,一个由大语言模型智能体驱动的自主机器学习研究框架。该系统旨在通过在约束条件下自动生成和实现研究想法来提升机器学习研究效率。我们的工作于2024年8月发布(与AI-Scientist同期),并获得了领先项目的显著认可。我们通过后续训练进一步增强了构思能力。该框架包含三个阶段:想法生成、实验实现和代码执行。首先,利用现有研究论文,由强化学习调优的LLM驱动的IdeaAgent生成可行的想法和实验计划。接着,ExperimentAgent利用检索到的原型代码,将计划转换为可执行代码,并可选择从HuggingFace检索候选模型和数据。在最后阶段,ExperimentAgent运行实验,并允许后续的调试和人类反馈,以提高获得可执行结果的成功率。我们在五个机器学习研究任务上评估了该框架。实验结果表明,我们的框架具有促进机器学习研究进展和创新的潜力。

英文摘要:

Autonomous machine learning research has gained significant attention recently. We present MLR-COPILOT, an autonomous Machine Learning Research framework powered by large language model agents. The system is designed to enhance ML research productivity through automatic generation and implementation of research ideas within constraints. Our work was released in August 2024 (concurrent to AI-Scientist) and has gained notable recognition from leading projects. We further enhance our ideation with training afterwards. The framework consists of three stages: idea generation, experiment implementation, and code execution. First, existing research papers are used to generate feasible ideas and experiment plans with IdeaAgent, powered by an RL-tuned LLM. Next, ExperimentAgent leverages retrieved prototype code to convert plans into executable code with optionally retrieved candidate models and data from HuggingFace. In the final stage, ExperimentAgent runs experiments, and allows subsequent iterations of debugging and human feedback for a better chance of success with executable outcomes. We evaluate our framework on five machine learning research tasks. Experiment results demonstrate the potential of our framework to facilitate ML research progress and innovation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑