本文提出了一种将大语言模型(large language model,LLM)智能体集成到自动化生产系统中的新方法,旨在提升任务自动化水平与灵活性。我们基于自动化金字塔,在分层框架内组织生产运营。将原子操作功能建模为微服务,在专用数字孪生系统中通过接口调用执行,为生产流程编排提供了可扩展且灵活的基础。在该数字孪生系统中,底层的硬件特定数据经过语义增强,变得可被LLM解读,用于生产规划与控制任务。我们通过系统化的提示词引导大语言模型智能体解读这些生产专用数据与知识。当接收到用户请求或识别到触发事件时,LLM智能体生成工艺计划,随后该计划被分解为一系列原子操作,作为微服务在现实自动化系统中执行。我们在实验室的自动化模块化生产设施上实现了这一整体方案,通过具体案例研究展示了LLM如何处理生产规划与控制任务,最终打造出具备更高任务自动化水平与灵活性的直观生产设施。最后,我们指出了在自主系统中充分发挥大语言模型潜力存在的若干局限,并点明了其可观的应用效益。该系列正在进行的研究的演示可访问:https://github.com/YuchenXia/GPT4IndustrialAutomation
英文摘要:
This paper introduces a novel approach to integrating large language model (LLM) agents into automated production systems, aimed at enhancing task automation and flexibility. We organize production operations within a hierarchical framework based on the automation pyramid. Atomic operation functionalities are modeled as microservices, which are executed through interface invocation within a dedicated digital twin system. This allows for a scalable and flexible foundation for orchestrating production processes. In this digital twin system, low-level, hardware-specific data is semantically enriched and made interpretable for LLMs for production planning and control tasks. Large language model agents are systematically prompted to interpret these production-specific data and knowledge. Upon receiving a user request or identifying a triggering event, the LLM agents generate a process plan. This plan is then decomposed into a series of atomic operations, executed as microservices within the real-world automation system. We implement this overall approach on an automated modular production facility at our laboratory, demonstrating how the LLMs can handle production planning and control tasks through a concrete case study. This results in an intuitive production facility with higher levels of task automation and flexibility. Finally, we reveal the several limitations in realizing the full potential of the large language models in autonomous systems and point out promising benefits. Demos of this series of ongoing research series can be accessed at: https://github.com/YuchenXia/GPT4IndustrialAutomation
Look Before You Leap: A GUI-Critic-R1 Model for Pre-Operative Error Diagnosis in GUI Automation
MAIS, Institute of Automation, Chinese Academy of Sciences, China(自动化研究所,中国科学院,中国);School of Artificial Intelligence, University of Chinese Academy of Sciences, China(中国科学院大学人工智能学院,中国);Alibaba Group(阿里巴巴集团)
Comprehensive Evaluation and Insights into the Use of Large Language Models in the Automation of Behavior-Driven Development Acceptance Test Formulation
Compiled AI: Deterministic Code Generation for LLM-Based Workflow Automation
XY.AI Labs, Palo Alto, CA(XY.AI实验室,帕洛阿尔托);Stanford University School of Medicine, Stanford, CA(斯坦福大学医学院,斯坦福);Cornell University, Department of Computer Science, Ithaca, NY(康奈尔大学计算机科学系,伊萨卡);Brigham and Women’s Hospital / Harvard Medical School, Boston, MA(布莱根妇女医院/哈佛医学院,波士顿)
VDSAgents: A PCS-Guided Multi-Agent System for Veridical Data Science Automation
School of Management, Xi’an Jiaotong University(西安交通大学管理学院);School of Computing, National University of Singapore(新加坡国立大学计算机学院);School of Data Science and Media Intelligence, Communication University of China(中国传媒大学数据科学与媒体智能学院);Beijing Baixingkefu Network Technology Co., Ltd.(北京百星科技网络技术有限公司)