arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.16140cs.HCcs.AI
收藏

大型语言模型集成建筑能源管理系统中的人机协作:用户领域知识与AI素养的作用

Human-AI Collaboration in Large Language Model-Integrated Building Energy Management Systems: The Role of User Domain Knowledge and AI Literacy

The University of Arizona(亚利桑那大学);Illinois Institute of Technology(伊利诺伊理工学院)

Wooyoung Jung, Kahyun Jeon, Prosper Babon-Ayeng

AI总结:

研究探讨用户领域知识与AI素养对LLM集成建筑能源管理系统中人机协作的影响,发现AI素养驱动电器识别率的显著差异,揭示LLMs在不同专业水平间的均等化效应。

摘要:

本研究旨在理解用户领域知识和人工智能(AI)素养如何影响人类与AI交互式建筑能源管理系统(BEMS)的有效使用。尽管先前研究已探讨将大型语言模型(LLMs)整合到BEMS或建筑能源建模中的潜力,但非常少有研究考察了用户如何与此类系统互动。我们进行了一项系统性的角色扮演实验,其中85名人类受试者与先进的生成预训练转换器(OpenAI GPT-4o)互动。受试者需确定通过GPT模型(作为LLM集成的BEMS)可减少家庭能源使用的前五种行为变化。然后,收集的提示-响应数据和受试者的结论通过一种分析框架进行分析,该框架分层评估和评分人类-AI互动及其家庭能源分析方法。此外,受试者根据其自我评估的建筑能源使用领域知识和AI素养分为四组,并在20个可量化的指标上进行了Kruskal-Wallis H检验及事后成对比较。关键发现包括:大多数受试者使用简洁的提示(中位数:16.2个词)并高度依赖GPT的分析能力;值得注意的是,20个指标中仅有1个(电器识别率)显示出统计学显著的组间差异(p=0.037),由AI素养而非领域知识驱动,表明LLMs在不同专业水平之间具有均等化效果。本研究为人类-AI协作动态提供了基础见解,并在LLM集成BEMS的背景下提供了有前景的发展方向,同时有助于实现以人为本的LLM集成能源系统。

英文摘要:

This study aimed to comprehend how user domain knowledge and artificial intelligence (AI) literacy impact the effective use of human-AI interactive building energy management system (BEMS). While prior studies have investigated the potential of integrating large language models (LLMs) into BEMS or building energy modeling, very few studies have examined how user interact with such systems. We conducted a systematic role-playing experiment, where 85 human subjects interacted with an advanced generative pre-trained transformer (OpenAI GPT-4o). Participants were tasked with identifying the top five behavioral changes that could reduce home energy use with the GPT model that functioned as an LLM-integrated BEMS. Then, the collected prompt-response data and participant conclusions were analyzed using an analytical framework that hierarchically assessed and scored human-AI interactions and their home energy analysis approaches. Also, participants were classified into four groups based on their self-evaluated domain knowledge of building energy use and AI literacy, and Kruskal-Wallis H tests with post-hoc pairwise comparisons were conducted across 20 quantifiable metrics. Key takeaways include: most participants employed concise prompts (median: 16.2 words) and relied heavily on GPT's analytical capabilities; and notably, only 1 of 20 metrics, appliance identification rate, showed statistically significant group differences (p=0.037), driven by AI literacy rather than domain knowledge, suggesting an equalizing effect of LLMs across expertise levels. This study provides foundational insights into human-AI collaboration dynamics and promising development directions in the context of LLM-integrated BEMS and contributes to realizing human-centric LLM-integrated energy systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑