This study aimed to comprehend how user domain knowledge and artificial intelligence (AI) literacy impact the effective use of human-AI interactive building energy management system (BEMS). While prior studies have investigated the potential of integrating large language models (LLMs) into BEMS or building energy modeling, very few studies have examined how user interact with such systems. We conducted a systematic role-playing experiment, where 85 human subjects interacted with an advanced generative pre-trained transformer (OpenAI GPT-4o). Participants were tasked with identifying the top five behavioral changes that could reduce home energy use with the GPT model that functioned as an LLM-integrated BEMS. Then, the collected prompt-response data and participant conclusions were analyzed using an analytical framework that hierarchically assessed and scored human-AI interactions and their home energy analysis approaches. Also, participants were classified into four groups based on their self-evaluated domain knowledge of building energy use and AI literacy, and Kruskal-Wallis H tests with post-hoc pairwise comparisons were conducted across 20 quantifiable metrics. Key takeaways include: most participants employed concise prompts (median: 16.2 words) and relied heavily on GPT's analytical capabilities; and notably, only 1 of 20 metrics, appliance identification rate, showed statistically significant group differences (p=0.037), driven by AI literacy rather than domain knowledge, suggesting an equalizing effect of LLMs across expertise levels. This study provides foundational insights into human-AI collaboration dynamics and promising development directions in the context of LLM-integrated BEMS and contributes to realizing human-centric LLM-integrated energy systems.
Rethinking Generative AI Literacy: An Integrative, Developmental, and Dialectical Framework for K-12 Teacher Education
University of Maryland Baltimore County(马里兰大学巴尔的摩分校);Kent State University(肯特州立大学);Pennsylvania State University(宾夕法尼亚州立大学);The University of Alabama(阿拉巴马大学);George Washington University(乔治华盛顿大学);Pepperdine University(佩珀代因大学);Universiti Malaya(马来亚大学);Begum Rokeya University(贝古姆·罗姬娅大学)
Generativism: Toward a Learning Theory for the Age of Generative Artificial Intelligence
Department of Education and Human Services, College of Education, Lehigh University(教育与人类服务系,教育学院,莱维大学);Department of Community and Global Health, College of Health, Lehigh University(社区与全球健康系,健康学院,莱维大学)
The Impact of Artificial Intelligence on Strategic Technology Management: A Mixed-Methods Analysis of Resources, Capabilities, and Human-AI Collaboration
Università Telematica Internazionale Uninettuno(国际乌尼内图诺电子大学);Longford International College, Università Telematica Internazionale Uninettuno(朗福德国际学院,国际乌尼内图诺电子大学)