AI for IT Operations (AIOps) aims to automate complex operational tasks, such as fault localization and root cause analysis, to reduce human workload and minimize customer impact. While traditional DevOps tools and AIOps algorithms often focus on addressing isolated operational tasks, recent advances in Large Language Models (LLMs) and AI agents are revolutionizing AIOps by enabling end-to-end and multitask automation. This paper envisions a future where AI agents autonomously manage operational tasks throughout the entire incident lifecycle, leading to self-healing cloud systems, a paradigm we term AgentOps. Realizing this vision requires a comprehensive framework to guide the design, development, and evaluation of these agents. To this end, we present AIOPSLAB, a framework that not only deploys microservice cloud environments, injects faults, generates workloads, and exports telemetry data but also orchestrates these components and provides interfaces for interacting with and evaluating agents. We discuss the key requirements for such a holistic framework and demonstrate how AIOPSLAB can facilitate the evaluation of next-generation AIOps agents. Through evaluations of state-of-the-art LLM agents within the benchmark created by AIOPSLAB, we provide insights into their capabilities and limitations in handling complex operational tasks in cloud environments.
Building AI Agents for Autonomous Clouds: Challenges and Design Principles
Microsoft(微软公司);University of California, Berkeley(加州大学伯克利分校);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Indian Institue of Science(印度科学学院);Microsoft Research(微软研究院);Agnes Scott College(阿格尼斯斯科特学院)
"A Good Bot Always Knows Its Limitations": Assessing Autonomous System Decision-making Competencies through Factorized Machine Self-confidence
RTX Technology Research Center(RTX技术研究中心);Smead Aerospace Engineering Sciences, University of Colorado Boulder(科罗拉多大学博尔德分校斯米德航空航天科学学院);Allen Institute for Brain Science(艾伦脑科学研究所)
AOI: Context-Aware Multi-Agent Operations via Dynamic Scheduling and Hierarchical Memory Compression
Columbia University(哥伦比亚大学);Hunan University(湖南大学);Central University of Finance and Economics(中央财经大学);Chongqing University(重庆大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);AI Agent Lab, Vokram Group(Vokram集团人工智能代理实验室);College of William and Mary(威廉与玛丽学院);University of Texas(得克萨斯大学);Zhengzhou University of Light Industry(郑州轻工业大学);Emory University(埃默里大学);Department of Nephrology, Affiliated Hospital of Guangdong Medical University(广东医科大学附属医院肾病科)
VLM-E2E: Enhancing End-to-End Autonomous Driving with Multimodal Driver Attention Fusion
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Li Auto Inc.(Li汽车公司);the School of Aeronautics and Astronautics, Xiamen University(厦门大学航空航天学院);The Hong Kong University of Science and Technology(香港科技大学)