We present VisionClaw, an always-on wearable AI agent that integrates live egocentric perception with agentic task execution. Running on Meta Ray-Ban smart glasses, VisionClaw continuously perceives real-world context and enables in-situ, speech-driven action initiation and delegation via OpenClaw AI agents. Therefore, users can directly execute tasks through the smart glasses, such as adding real-world objects to an Amazon cart, generating notes from physical documents, receiving meeting briefings on the go, creating events from posters, or controlling IoT devices. We evaluate VisionClaw through a controlled laboratory study (N=12) and a longitudinal deployment study (N=5). Results show that integrating perception and execution enables faster task completion and reduces interaction overhead compared to non-always-on and non-agent baselines. Beyond performance gains, deployment findings reveal a shift in interaction: tasks are initiated opportunistically during ongoing activities, and execution is increasingly delegated rather than manually controlled. These results suggest a new paradigm for wearable AI agents, where perception and action are continuously coupled to support situated, hands-free interaction.
Reshaping Inclusive Interpersonal Dynamics through Smart Glasses in Mixed-Vision Social Activities
The Future Laboratory, Tsinghua University(清华大学未来实验室);Human Centered Design & Engineering, University of Washington(华盛顿大学人机交互设计与工程);School of Design, Hong Kong Polytechnic University(香港理工大学设计学院);College of Arts, Media and Design, Northeastern University(东北大学艺术、媒体与设计学院);Central Academy of Fine Arts(中央美术学院);School of Design, Shanghai Jiao Tong University(上海交通大学设计学院);Academy of Arts & Design, Tsinghua University(清华大学美术学院)
Egocentric Co-Pilot: Web-Native Smart-Glasses Agents for Assistive Egocentric AI
Shenzhen International Graduate School Tsinghua University Shenzhen China(深圳国际研究生院清华大学深圳中国);Independent Researcher London United Kingdom(独立研究者伦敦英国);Queen Mary University of London London United Kingdom(女王玛丽大学伦敦英国);Imperial College London London United Kingdom(帝国理工学院伦敦英国);University Of Surrey Guildford United Kingdom(Surrey大学Guildford英国)
Active noise cancellation on open-ear smart glasses
Department of Electrical and Computer Engineering, Carnegie Mellon University(卡内基梅隆大学电气与计算机工程系);Department of Medical Physics and Acoustics, Carl von Ossietzky Universität Oldenburg(奥尔登堡大学医学物理与声学系);College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院)
CRAFT: Exploring Wearable Creative AI on Smart Glasses for Fiction Writing in Real-World Contexts
National University of Singapore(新加坡国立大学);City University of Hong Kong(香港城市大学);The Hong Kong University of Science and Technology(香港科技大学);The Chinese University of Hong Kong(香港中文大学)
LabOS: The AI-XR Co-Scientist That Sees and Works With Humans
Stanford University School of Medicine(斯坦福大学医学院);Princeton University(普林斯顿大学);Oregon State University(俄勒冈州立大学);University of Washington(华盛顿大学);NVIDIA(英伟达)
Multimodal Fusion with LLMs for Engagement Prediction in Natural Conversation
Computer Science Department, Carnegie Mellon University(卡内基梅隆大学计算机科学系);Robotics Institute, Carnegie Mellon University(卡内基梅隆大学机器人研究所);Neuroscience Institute, Carnegie Mellon University(卡内基梅隆大学神经科学研究所);Department of Psychology, The University of Texas at Austin(德克萨斯大学奥斯汀分校心理学系);Center for Perceptual Systems, The University of Texas at Austin(德克萨斯大学奥斯汀分校感知系统中心)
Heads Up eXperience (HUX): Always-On AI Companion for Human Computer Environment Interaction
Vellore Institute of Technology - Chennai(韦洛尔理工大学 Chennai校区);Shiv Nadar University - Chennai(希夫纳达尔大学 Chennai校区);Indian Institute of Technology - Kanpur(坎普尔印度理工学院)
本文提出 HUX AI 系统,通过追踪眼动、分析环境与解读语音实现多模态数据增强,旨在扩展现实环境中作为常驻 AI 伴侣,弥合数字与物理交互差距,革新人机协作。