arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2308.03028cs.AI
收藏

用于工业控制的预训练大语言模型

Pre-Trained Large Language Models for Industrial Control

Microsoft Research Asia(微软亚洲研究院)

Lei Song, Chuheng Zhang, Li Zhao, Jiang Bian

AI总结:

本文以HVAC控制为例,将工业控制任务包装为语言游戏,考察GPT-4作为控制器的性能与泛化能力,发现其以少量样本和低技术债务达到与强化学习方法相当的效果,展示了基础模型直接用于工业控制的潜力。

摘要:

对于工业控制而言,以少量样本和低技术债务开发高性能控制器具有吸引力。基础模型拥有通过互联网规模语料预训练获得的丰富先验知识,在适当的提示下有望成为良好的控制器。本文以HVAC(供暖、通风和空调)建筑控制为例,考察GPT-4(第一梯队基础模型之一)作为控制器的能力。为控制HVAC,我们将该任务包装为一个语言游戏:在每一步向GPT-4提供文本,包括任务的简短描述、若干精选演示以及当前观测,并执行GPT-4回应的动作。我们进行了一系列实验以回答以下问题:1)GPT-4控制HVAC的效果如何?2)GPT-4在不同HVAC控制场景下的泛化能力如何?3)文本上下文的不同部分如何影响性能?总体而言,我们发现GPT-4以少量样本和低技术债务达到了与强化学习方法相当的性能,表明将基础模型直接应用于工业控制任务的潜力。

英文摘要:

For industrial control, developing high-performance controllers with few samples and low technical debt is appealing. Foundation models, possessing rich prior knowledge obtained from pre-training with Internet-scale corpus, have the potential to be a good controller with proper prompts. In this paper, we take HVAC (Heating, Ventilation, and Air Conditioning) building control as an example to examine the ability of GPT-4 (one of the first-tier foundation models) as the controller. To control HVAC, we wrap the task as a language game by providing text including a short description for the task, several selected demonstrations, and the current observation to GPT-4 on each step and execute the actions responded by GPT-4. We conduct series of experiments to answer the following questions: 1)~How well can GPT-4 control HVAC? 2)~How well can GPT-4 generalize to different scenarios for HVAC control? 3) How different parts of the text context affect the performance? In general, we found GPT-4 achieves the performance comparable to RL methods with few samples and low technical debt, indicating the potential of directly applying foundation models to industrial control tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑