From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agents
Department of Computer Science, Rensselaer Polytechnic Institute(伦斯勒理工学院计算机科学系);IBM Research(IBM研究院);Department of Mechanical, Aerospace, and Nuclear Engineering, Rensselaer Polytechnic Institute(伦斯勒理工学院机械、航空航天与核工程系)
Large language model (LLM)-based systems are becoming increasingly popular for solving tasks by constructing executable workflows that interleave LLM calls, information retrieval, tool use, code execution, memory updates, and verification. This survey reviews recent methods for designing and optimizing such workflows, which we treat as agentic computation graphs (ACGs). We organize the literature based on when workflow structure is determined, where structure refers to which components or agents are present, how they depend on each other, and how information flows between them. This lens distinguishes static methods, which fix a reusable workflow scaffold before deployment, from dynamic methods, which select, generate, or revise the workflow for a particular run before or during execution. We further organize prior work along three dimensions: when structure is determined, what part of the workflow is optimized, and which evaluation signals guide optimization (e.g., task metrics, verifier signals, preferences, or trace-derived feedback). We also distinguish reusable workflow templates, run-specific realized graphs, and execution traces, separating reusable design choices from the structures actually deployed in a given run and from realized runtime behavior. Finally, we outline a structure-aware evaluation perspective that complements downstream task metrics with graph-level properties, execution cost, robustness, and structural variation across inputs. Our goal is to provide a clear vocabulary, a unified framework for positioning new methods, a more comparable view of existing body of literature, and a more reproducible evaluation standard for future work in workflow optimizations for LLM agents.
Workflow-to-Skill: Skill Creation via Routing-Workflow-Semantics-Attachments Decomposition
Key Laboratory of Aerospace Information Security and Trusted Computing, Ministry of Education, School of Cyber Science and Engineering, Wuhan University(航天信息安全部门与可信计算重点实验室,教育部,网络安全科学与工程学院,武汉大学);Nanchang University(南昌大学)
An Organization-Scoped LLM Agent Runtime Architecture for Regulated Cybersecurity Operations
Innov-Acts Ltd(Innov-Acts有限公司);Dept. of Digital Systems University of Piraeus(数字系统系希腊比雷埃克斯大学);Harokopio University(哈罗基奥大学);Dept. of Informatics and Telematics(信息学与电信系)
The Foundations of Computational Management: A Systematic Approach to Task Automation for the Integration of Artificial Intelligence into Existing Workflows
Vivenxia Group LLC(Vivenxia集团有限责任公司);Centre for Digital Therapeutics(数字治疗中心);University of Southern California(南加州大学)
Complexity and Scale in AI-Assisted Workflow Management: A Federated Learning Case Study
RENCI, University of North Carolina at Chapel Hill, NC, USA(RENCI,北卡罗来纳大学教堂山分校);Information Sciences Institute, University of Southern California, Marina del Rey, CA, USA(信息科学研究所,南加州大学马里纳德尔雷耶斯分校)
Scalable Runtime Architecture for Data-driven, Hybrid HPC and ML Workflow Applications
Rutgers, the State University of New Jersey(罗格斯大学(新泽西州立大学));Brookhaven National Laboratory(布鲁克海文国家实验室);Princeton Plasma Physics Laboratory(普林斯顿等离子体物理实验室);Princeton University(普林斯顿大学)
本文扩展 RADICAL-Pilot,提出支持基于服务执行的可扩展运行时架构,以实现跨本地与远程 HPC/云资源的 HPC/ML 无缝耦合和低开销并发 ML 执行。
Composing Verifiable Conceptual Models via Building Blocks: Towards Design-Time Verification of Agentic AI Workflows
Team EVERGREEN Inria Centre Inria d’Université Côte d’Azur(法国国家信息与自动化研究所蔚蓝海岸大学中心EVERGREEN团队);Department of Data Science William & Mary(威廉与玛丽学院数据科学系);Office of Enterprise Research and Innovation Old Dominion University(欧道明大学企业研究与创新办公室)