AI agents -- systems that combine foundation models with reasoning, planning, memory, and tool use -- are rapidly becoming a practical interface between natural-language intent and real-world computation. This survey synthesizes the emerging landscape of AI agent architectures across: (i) deliberation and reasoning (e.g., chain-of-thought-style decomposition, self-reflection and verification, and constraint-aware decision making), (ii) planning and control (from reactive policies to hierarchical and multi-step planners), and (iii) tool calling and environment interaction (retrieval, code execution, APIs, and multimodal perception). We organize prior work into a unified taxonomy spanning agent components (policy/LLM core, memory, world models, planners, tool routers, and critics), orchestration patterns (single-agent vs.\ multi-agent; centralized vs.\ decentralized coordination), and deployment settings (offline analysis vs.\ online interactive assistance; safety-critical vs.\ open-ended tasks). We discuss key design trade-offs -- latency vs.\ accuracy, autonomy vs.\ controllability, and capability vs.\ reliability -- and highlight how evaluation is complicated by non-determinism, long-horizon credit assignment, tool and environment variability, and hidden costs such as retries and context growth. Finally, we summarize measurement and benchmarking practices (task suites, human preference and utility metrics, success under constraints, robustness and security) and identify open challenges including verification and guardrails for tool actions, scalable memory and context management, interpretability of agent decisions, and reproducible evaluation under realistic workloads.
Agentic AI-based Coverage Closure for Formal Verification
1 Infineon Technologies India Private Limited, India 2 Dr. B R Ambedkar National Institute of Technology Jalandhar, India 3 Infineon Technologies Dresden AG \& Co. KG, Germany
Limits to Verification and Validation of Agentic Behavior
代理行为的验证和确认已被建议作为重要的研究重点,以减少与创建通用人工智能相关的风险(Russell et al 2015)。在本文中,我们质疑使用语言的确定性方面的努力,以管理这种风险的适当性。我们首先建立了一个非常一般的形式主义来描述代理行为和可接受的行为的标准。我们表明,确定一个代理是否符合任何特定的标准是不可计算的。我们讨论了与人工证明和自动化行为治理验证相关的负担程度。我们表明,为了确保行为标准本身的可判定性,必须进一步限制代理的能力。然后,我们证明,如果我们的关注涉及到在物理世界的结果,验证的尝试是徒劳的。最后,我们表明,分层架构旨在使这些挑战易于处理的错误等同于意图与行动或结果,从而无法提供任何保证。最后,我们讨论了为什么确定性语言应该从关于一般人工智能安全性的对话中根除。
Composing Verifiable Conceptual Models via Building Blocks: Towards Design-Time Verification of Agentic AI Workflows
Team EVERGREEN Inria Centre Inria d’Université Côte d’Azur(法国国家信息与自动化研究所蔚蓝海岸大学中心EVERGREEN团队);Department of Data Science William & Mary(威廉与玛丽学院数据科学系);Office of Enterprise Research and Innovation Old Dominion University(欧道明大学企业研究与创新办公室)
GDPR Auto-Formalization with AI Agents and Human Verification
Center for Juris-Informatics, ROIS-DS(法律信息中心,ROIS-DS);Ruhr-University Bochum, RC-Trust(波恩鲁尔大学,RC-Trust);Alberta Machine Intelligence Institute, University of Alberta(阿尔伯塔机器智能研究所,阿尔伯塔大学)
Luban: Building Open-Ended Creative Agents via Autonomous Embodied Verification
University of Science and Technology of China(中国科学技术大学);Institute of Computing Technology, CAS(中国科学院计算技术研究所);Cambricon Technologies(寒武纪科技);Intelligent Software Research Center, Institute of Software, CAS(中国科学院软件研究所智能软件研究中心);University of Chinese Academy of Sciences(中国科学院大学);Shanghai Innovation Center for Processor Technologies(上海处理器技术创新中心)
AIVV: Neuro-Symbolic LLM Agent-Integrated Verification and Validation for Trustworthy Autonomous Systems
School of Mechanical Engineering, Purdue University(普渡大学机械工程学院);School of Electrical and Computer Engineering, Purdue University(普渡大学电气与计算机工程学院);Department of Computer Science, Purdue University(普渡大学计算机科学系);Department of Mathematics, Purdue University(普渡大学数学系)