Advancements in sensor technology, artificial intelligence (AI), and augmented reality (AR) have unlocked opportunities across various domains. AR and large language models like GPT have witnessed substantial progress and are increasingly being employed in diverse fields. One such promising application is in operations and maintenance (O&M). O&M tasks often involve complex procedures and sequences that can be challenging to memorize and execute correctly, particularly for novices or under high-stress situations. By marrying the advantages of superimposing virtual objects onto the physical world, and generating human-like text using GPT, we can revolutionize O&M operations. This study introduces a system that combines AR, Optical Character Recognition (OCR), and the GPT language model to optimize user performance while offering trustworthy interactions and alleviating workload in O&M tasks. This system provides an interactive virtual environment controlled by the Unity game engine, facilitating a seamless interaction between virtual and physical realities. A case study (N=15) is conducted to illustrate the findings and answer the research questions. The results indicate that users can complete similarly challenging tasks in less time using our proposed AR and AI system. Moreover, the collected data also suggests a reduction in cognitive load and an increase in trust when executing the same operations using the AR and AI system.
Evaluating Digital Work Instructions with Augmented Reality versus Paper-based Documents for Manual, Object-Specific Repair Tasks in a Case Study with Experienced Workers
Beyond Reality: The Pivotal Role of Generative AI in the Metaverse
BITS-Pilani(比尔拉科学技术学院);National University of Singapore(新加坡国立大学);Kalinga Institute of Industrial Technology(卡林加工业技术学院);University of Kentucky(肯塔基大学);Edinburgh Napier University(爱丁堡龙比亚大学);Nanyang Technological University(南洋理工大学);Qatar University(卡塔尔大学)
Visualization of Real-time Displacement Time History superimposed with Dynamic Experiments using Wireless Smart Sensors (WSS) and Augmented Reality (AR)
Cross-reality location privacy protection in 6G-enabled vehicular metaverses: an LLM-enhanced hybrid generative diffusion model-based approach
School of Automation, Guangdong University of Technology(自动化学院,广东技术大学);School of Computer Science and Engineering, Nanyang Technological University(计算机科学与工程学院,南洋理工大学);Department of Electrical and Computer Engineering, University of Manitoba(电气与计算机工程系,曼尼托巴大学);Department of Electrical and Computer Engineering, Sungkyunkwan University(电气与计算机工程系,成均馆大学)