Automated paper reproduction has emerged as a promising approach to accelerate scientific research, employing multi-step workflow frameworks to systematically convert academic papers into executable code. However, existing frameworks often lack mechanisms to verify and refine the outputs at each generation step, or rely heavily on manually designed prompts for self-refinement, which limits their adaptability and scalability. To address these limitations, we propose a prompt-free collaborative agent framework that automatically enhances the quality of paper-to-code generation. Our approach employs two collaborative agents: a verification agent that examines whether the outputs at each step satisfy the requirements specified in the corresponding system prompt, and a refinement agent that revises the outputs based on the identified issues. Unlike previous methods that require human experts to craft specific refinement prompts for each step, our framework achieves automatic verification and improvement by leveraging only the original system prompts. We integrate our collaborative agents into the Paper2Code framework and conduct comprehensive experiments on PaperBench Code-Dev and Paper2CodeBench datasets. Experimental results demonstrate that our approach significantly improves the accuracy and completeness of reproduced code, achieving performance gains of approximately 15\% and 13\%, respectively, compared to the baseline without our agents. Furthermore, comparative experiments against Self-Refine validate the robustness and consistency of our prompt-free approach across different datasets.
Enhancing Text Annotation through Rationale-Driven Collaborative Few-Shot Prompting
Institute of Artificial Intelligence and Future Networks, Beijing Normal University(北京师范大学人工智能与未来网络研究院);Hong Kong Baptist University(香港浸会大学);BNU-HKBU United International College(北京师范大学-香港浸会大学联合国际学院);College of Artificial Intelligence, Beijing Normal University(北京师范大学人工智能学院)
LLM Agents as Social Scientists: A Human-AI Collaborative Platform for Social Science Automation
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);Beijing Key Laboratory of Big Data Management and Analysis Methods(大数据管理与分析方法北京市重点实验室)
HRCF: Enhancing Collaborative Filtering via Hyperbolic Geometric Regularization
The Chinese University of Hong Kong(香港中文大学);Huawei Noah’s Ark Lab(华为诺亚方舟实验室);Harbin Institute of Technology(哈尔滨工业大学);University of Science and Technology of China(中国科学技术大学)
Enhancing Scene Classification in Cloudy Image Scenarios: A Collaborative Transfer Method with Information Regulation Mechanism using Optical Cloud-Covered and SAR Remote Sensing Images
School of Geosciences and Info-Physics, Central South University(中南大学地球科学与信息物理学院);Faculty of Geo-Information Science and Earth Observation (ITC), University of Twente(特文特大学地球信息科学与地球观测学院)
Enhancing Human-Robot Collaboration through Existing Guidelines: A Case Study Approach
Nagoya University(名古屋大学);IMAGINARY Corporation(IMAGINARY公司);Atelier Corporation(Atelier公司);National Institute of Advanced Industrial Science and Technology (AIST)(独立行政法人产业技术综合研究所(AIST))
Swarm Intelligence in Geo-Localization: A Multi-Agent Large Vision-Language Model Collaborative Framework
City University of Hong Kong(香港城市大学);University of Science and Technology of China(中国科学技术大学);Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州))
CMAT: A Multi-Agent Collaboration Tuning Framework for Enhancing Small Language Models
East China Jiaotong University(华东交通大学);University of Minnesota - Twin Cities(明尼苏达大学双城分校);Guangdong University of Technology(广东工业大学);University of Electronic Science and Technology of China(电子科技大学);University of Toronto(多伦多大学);East China Normal University(华东师范大学)
ComfyBench: Benchmarking LLM-based Agents in ComfyUI for Autonomously Designing Collaborative AI Systems
Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Shanghai Jiao Tong University(上海交通大学);The University of Sydney(悉尼大学);The Chinese University of Hong Kong(香港中文大学)