The advent of Large Language Models (LLMs) has created new opportunities for the automation of scientific research spanning both experimental processes and computational simulations. This study explores the feasibility of constructing an autonomous simulation agent (ASA) powered by LLMs through prompt engineering and automated program design to automate the entire simulation research process according to a human-provided research plan. This process includes experimental design, remote upload and simulation execution, data analysis, and report compilation. Using a well-studied simulation problem of polymer chain conformations as a test case, we assessed the long-task completion and reliability of ASAs powered by different LLMs, including GPT-4o, Claude-3.5, etc. Our findings revealed that ASA-GPT-4o achieved near-flawless execution on designated research missions, underscoring the potential of methods like ASA to achieve automation in simulation research processes to enhance research efficiency. The outlined automation can be iteratively performed for up to 20 cycles without human intervention, illustrating the potential of ASA for long-task workflow automation. Additionally, we discussed the intrinsic traits of ASA in managing extensive tasks, focusing on self-validation mechanisms, and the balance between local attention and global oversight.
Spider2-V: How Far Are Multimodal Agents From Automating Data Science and Engineering Workflows?
The University of Hong Kong(香港大学);Shanghai Jiao Tong University(上海交通大学);Google Cloud AI Research(谷歌云人工智能研究院);Google DeepMind(谷歌DeepMind);Salesforce Research(salesforce研究院);Yale University(耶鲁大学);Sea AI Lab(Sea人工智能实验室);University of Waterloo(滑铁卢大学)
Harnessing LLMs for Automated Video Content Analysis: An Exploratory Workflow of Short Videos on Depression
The University of Texas at Austin(德克萨斯大学奥斯汀分校);Institute of High Performance Computing (IHPC), A*STAR(高性能计算研究所(A*STAR));Pennsylvania State University(宾夕法尼亚州立大学);Clark University(克拉克大学);Columbia University(哥伦比亚大学)
MechMath: Sorrifier-Driven Formal Decomposition Workflow for Automated Theorem Proving
Academy of Mathematics and Systems Science, CAS(数学与系统科学研究院,中国科学院);School of Advanced Interdisciplinary Sciences, UCAS(交叉科学学院,中国科学院大学);School of Mathematical Science, UCAS(数学科学学院,中国科学院大学)
A Sober Look at Agentic Misalignment in Automated Workflows
University of Virginia(弗吉尼亚大学);Georgia Institute of Technology(佐治亚理工学院);University of Utah(犹他大学);University of Notre Dame(圣约翰大学);George Washington University(乔治华盛顿大学)
Automated Lesion Segmentation in Whole-Body PET/CT in a multitracer setting
Shanghai United Imaging Healthcare Advanced Technology Research Institute Co., Ltd.(上海联影医疗科技股份有限公司先进技术研究院);Shanghai Jiao Tong University(上海交通大学);East China Normal University(华东师范大学)
It`s All About Speed: AI`s Impact on Workflow in Music Production
Waipapa Taumata Rau - University of Auckland, Auckland (Aotearoa - New Zealand)(瓦伊帕塔玛拉大学——奥克兰大学,奥克兰(奥特亚罗——新西兰));Sony AI, Barcelona (Spain)(索尼AI,巴塞罗那(西班牙))
CaosDB - Research Data Management for Complex, Changing, and Automated Research Workflows
Max Planck Institute for Dynamics and Self-Organization(马克斯·普朗克动力学与自组织研究所);Georg-August-Universität(格奥尔格·奥古斯特大学);German Center for Cardiovascular Research (DZHK)(德国心血管研究中心(DZHK));University Medical Center Göttingen(哥廷根大学医学中心);Northeastern University(东北大学)
WirelessAgent++: Automated Agentic Workflow Design and Benchmarking for Wireless Networks
College of Electronics and Information Engineering, Shenzhen University(深圳大学电子与信息工程学院);Department of Electronic and Computer Engineering, The Hong Kong University of Science and Technology(香港理工大学电子与计算机工程系)
RefGrader: Automated Grading of Mathematical Competition Proofs using Agentic Workflows
Pennsylvania State University(宾夕法尼亚州立大学);City University of New York(纽约市立大学);New York University(纽约大学);Amirkabir University of Technology(阿米尔卡比尔理工大学);Autodesk(欧特克公司);Carnegie Mellon University(卡内基梅隆大学)
HyEvo: Self-Evolving Hybrid Agentic Workflows for Efficient Reasoning
East China Normal University(华东师范大学);Beihang University(北京航空航天大学);Shanghai University of International Business and Economics(上海对外经贸大学);Fudan University(复旦大学)