Autonomous machine learning research has gained significant attention recently. We present MLR-COPILOT, an autonomous Machine Learning Research framework powered by large language model agents. The system is designed to enhance ML research productivity through automatic generation and implementation of research ideas within constraints. Our work was released in August 2024 (concurrent to AI-Scientist) and has gained notable recognition from leading projects. We further enhance our ideation with training afterwards. The framework consists of three stages: idea generation, experiment implementation, and code execution. First, existing research papers are used to generate feasible ideas and experiment plans with IdeaAgent, powered by an RL-tuned LLM. Next, ExperimentAgent leverages retrieved prototype code to convert plans into executable code with optionally retrieved candidate models and data from HuggingFace. In the final stage, ExperimentAgent runs experiments, and allows subsequent iterations of debugging and human feedback for a better chance of success with executable outcomes. We evaluate our framework on five machine learning research tasks. Experiment results demonstrate the potential of our framework to facilitate ML research progress and innovation.
Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);University of Technology Sydney(悉尼科技大学);Northeastern University(东北大学);University of Liverpool(利物浦大学)
Copiloting Autonomous Multi-Robot Missions: A Game-inspired Supervisory Control Interface
Polytechnique Montreal(蒙特利尔理工学院);NASA Jet Propulsion Laboratory, California Institute of Technology(美国国家航空航天局喷气推进实验室,加州理工学院);University of Southern California(南加州大学);University of California, Riverside(加州大学河滨分校)
Building Multi-Agent Copilot towards Autonomous Agricultural Data Management and Analysis
University of Nebraska-Lincoln(内布拉斯加大学林肯分校);School of Computing, University of Nebraska-Lincoln(内布拉斯加大学林肯分校计算学院);School of Natural Resources, University of Nebraska-Lincoln(内布拉斯加大学林肯分校自然资源学院);Holland Computing Center, University of Nebraska-Lincoln(内布拉斯加大学林肯分校霍兰德计算中心);North Carolina State University(北卡罗来纳州立大学)
RedAgent: Red Teaming Large Language Models with Context-aware Autonomous Language Agent
The State Key Laboratory of Blockchain and Data Security, Zhejiang University(浙江大学区块链与数据安全国家重点实验室);School of Cyber Science and Technology, Zhejiang University(浙江大学网络科学与技术学院);Palo Alto Networks(派拓网络);University of North Texas(北得克萨斯大学)
Evidence-based diagnostic reasoning with multi-agent copilot for human pathology
Health Sciences and Technology, Harvard-MIT(哈佛-MIT健康科学与技术);Department of Pathology, Massachusetts General Hospital, Harvard Medical School(麻省总医院病理科,哈佛医学院);Cancer Program, Broad Institute of Harvard and MIT(哈佛-MIT博德研究所癌症项目);Harvard John A. Paulson School of Engineering and Applied Sciences, Harvard University(哈佛大学约翰·A·保尔森工程与应用科学学院);Electrical Engineering and Computer Science, Massachusetts Institute of Technology (MIT)(麻省理工学院电气工程与计算机科学);Harvard Data Science Initiative, Harvard University(哈佛大学数据科学计划)
AtomWorld: A Benchmark for Evaluating Spatial Reasoning in Large Language Models on Crystalline Materials
University of New South Wales, NSW, Sydney, Australia(新南威尔士大学,新州,悉尼,澳大利亚);Suzhou Institute for Advanced Research, University of Science(苏州先进研究院,科学大学);Shanghai Artificial Intelligence Laboratory, Shanghai, China(上海人工智能实验室,上海,中国);Cornell University(康奈尔大学)
提出AtomWorld基准,通过十种基本原子结构操作评估LLM在材料科学中的空间推理能力,发现Claude Opus 4.6表现最佳但复杂空间关系操作成功率低,表明LLM更适合作为辅助工具而非完全自主的科研代理。
A Self-Evolving AI Agent System for Climate Science
Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Fudan University(复旦大学);Institute of Atmospheric Physics, Chinese Academy of Sciences(中国科学院大气物理研究所);The University of Sydney(悉尼大学);Shanghai Jiao Tong University(上海交通大学);Nanjing University of Information Science and Technology(南京信息工程大学);Seoul National University(首尔大学);Ocean University of China(中国海洋大学);Laoshan Laboratory(崂山实验室);Columbia University(哥伦比亚大学);Japan Agency for Marine-Earth Science and Technology(日本海洋研究开发机构);The Chinese University of Hong Kong(香港中文大学);East China Normal University(华东师范大学);Chinese Academy of Meteorological Sciences(中国气象科学研究院);Tsinghua University(清华大学)