Artificial Intelligence (AI) significantly influences many fields, largely thanks to the vast amounts of high-quality data for machine learning models. The emphasis is now on a data-centric AI strategy, prioritizing data development over model design progress. Automating this process is crucial. In this paper, we serve as the first work to introduce the automatic data-centric development (AD^2) task and outline its core challenges, which require domain-experts-like task scheduling and implementation capability, largely unexplored by previous work.
By leveraging the strong complex problem-solving capabilities of large language models (LLMs), we propose an LLM-based autonomous agent, equipped with a strategy named Collaborative Knowledge-STudying-Enhanced Evolution by Retrieval (Co-STEER), to simultaneously address all the challenges. Specifically, our proposed Co-STEER agent enriches its domain knowledge through our proposed evolving strategy and develops both its scheduling and implementation skills by accumulating and retrieving domain-specific practical experience. With an improved schedule, the capability for implementation accelerates. Simultaneously, as implementation feedback becomes more thorough, the scheduling accuracy increases. These two capabilities evolve together through practical feedback, enabling a collaborative evolution process.
Extensive experimental results demonstrate that our Co-STEER agent breaks new ground in AD^2 research, possesses strong evolvable schedule and implementation ability, and demonstrates the significant effectiveness of its components. Our Co-STEER paves the way for AD^2 advancements.
From Perception to Planning: Evolving Ego-Centric Task-Oriented Spatiotemporal Reasoning via Curriculum Learning
Zhejiang University(浙江大学);Tianjin University(天津大学);Qingdao University(青岛大学);Shanghai Jiao Tong University(上海交通大学);National University of Singapore(新加坡国立大学)
A self-evolving multi-role collaborative framework with fine-grained difficulty guidance for innovative mathematical problem generation
School of Physics and Information Technology, Shaanxi Normal University(陕西师范大学物理与信息技术学院);Department of Computing Technologies, Swinburne University of Technology(斯威本科技大学计算技术系);Department of Software Engineering, University of Szeged(塞格德大学软件工程系)
Can We Steer the Black-Box? Towards Controllability-Centric Evaluation of Recommender Systems with Collaborative Agents
Institute of Information Engineering, Chinese Academy of Sciences, China(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences, China(中国科学院大学网络安全学院)
EvObj: Learning Evolving Object-centric Representations for 3D Instance Segmentation without Scene Supervision
Shenzhen Research Institute, The Hong Kong Polytechnic University(深圳研究 institute,香港理工大学);vLAR Group, The Hong Kong Polytechnic University(vLAR 团队,香港理工大学)
SkinGPT-X: A Self-Evolving Collaborative Multi-Agent System for Transparent and Trustworthy Dermatological Diagnosis
School of Data Science, The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳)数据科学学院);Department of Dermatology, Tianjin Institute of Integrative Dermatology, Tianjin Academy of Traditional Chinese Medicine Affiliated Hospital(天津中医药大学附属医院天津市中西医结合皮肤病研究所皮肤科);Department of Dermatology, Beijing AnZhen Hospital, Capital Medical University(首都医科大学附属北京安贞医院皮肤科)
CCL: Collaborative Curriculum Learning for Sparse-Reward Multi-Agent Reinforcement Learning via Co-evolutionary Task Evolution
Homesite Group Inc.(Homesite集团);Chewy Inc.(Chewy公司);University of Science and Technology Beijing(北京科技大学);Yunnan University of Finance and Economics(云南财经大学);Yunnan University(云南大学);The Australian National University(澳大利亚国立大学)