Proactive robot assistance in household environments requires accurate prediction of human activities and object usage under dynamic and noisy conditions. Existing approaches often rely on complex spatio-temporal models, which can be computationally expensive and sensitive to environmental variability. In this paper, we propose GLOBE, a lightweight framework that combines n-gram Markov models for capturing temporal behavioral patterns with uncertainty-guided large language model (LLM) reasoning. The framework performs sequential prediction efficiently while selectively invoking LLM reasoning only when the model confidence is low. To evaluate performance under realistic conditions, we introduce HOMER-Noise, a noisy extension of the HOMER+ dataset that simulates structured disturbances such as object movements caused by humans, pets, and toddlers. Experimental results show that GLOBE achieves competitive performance with state-of-the-art methods while improving robustness and computational efficiency across both clean and noisy settings. The framework is further validated through a proof-of-concept integration with a Stretch 3 mobile manipulator, demonstrating its potential application in real-world human-robot interaction scenarios.
Smart Help: Strategic Opponent Modeling for Proactive and Adaptive Robot Assistance in Households
Beijing Institute for General Artificial Intelligence (BIGAI)(北京通用人工智能研究院);State Key Laboratory of General Artificial Intelligence(通用人工智能国家重点实验室);Tsinghua University(清华大学);Peking University(北京大学);University of California, Los Angeles(加州大学洛杉矶分校)
Exploring Human-Robot Collaboration: Analysis of Interaction Modalities in Challenging Tasks
Dalle Molle Institute for Artificial Intelligence (IDSIA), USI-SUPSI(达勒莫勒人工智能研究所(IDSIA));Department of Surgery, Medicine, Dentistry and Morphological Sciences with interest in Transplant, Oncology and Regenerative Medicine, University of Modena and Reggio Emilia(外科、医学、牙科和形态学科学系(关注移植、肿瘤学和再生医学),摩德纳和雷吉奥艾米利亚大学);Department of Sciences and Methods for Engineering (DISMI), University of Modena and Reggio Emilia(工程科学与方法系(DISMI),摩德纳和雷吉奥艾米利亚大学)
Personalized Lower-limb Exoskeleton Assistance via Preference-based Bayesian Optimization
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学);Macau University of Science and Technology(澳门科技大学)
RobotEQ: Towards Social Proactive Intelligence in Embodied Agents
State Key Laboratory of Autonomous Intelligent Unmanned Systems, Tongji University(自主智能无人系统国家重点实验室,同济大学);Tsinghua University(清华大学);The Chinese University of Hong Kong(香港中文大学);CMVS, University of Oulu(奥卢大学CMVS)
AssistantX: An LLM-Powered Proactive Assistant in Collaborative Human-Populated Environment
Department of Computer Science and Technology, Tsinghua University(计算机科学与技术系,清华大学);School of Artificial Intelligence, Beijing University of Posts and Telecommunications(人工智能学院,北京邮电大学)