Adaptive and intelligent user interfaces have been proposed as a critical component of a successful extended reality (XR) system. In particular, a predictive system can make inferences about a user and provide them with task-relevant recommendations or adaptations. However, we believe such adaptive interfaces should carefully consider the overall \emph{cost} of interactions to better address uncertainty of predictions. In this position paper, we discuss a computational approach to adapt XR interfaces, with the goal of improving user experience and performance. Our novel model, applied to menu selection tasks, simulates user interactions by considering both cognitive and motor costs. In contrast to greedy algorithms that adapt based on predictions alone, our model holistically accounts for costs and benefits of adaptations towards adapting the interface and providing optimal recommendations to the user.
Backpropagation-Free Test-Time Adaptation for Lightweight EEG-Based Brain-Computer Interfaces
Ministry of Education Key Laboratory of Image Processing and Intelligent Control, School of Artificial Intelligence and Automation, Huazhong University of Science and Technology(教育部长图像处理与智能控制重点实验室,人工智能与自动化学院,华中科技大学);Shenzhen Huazhong University of Science and Technology Research Institute(深圳华中科技大学研究机构);Department of Electrical and Computer Engineering, Faculty of Science and Technology, University of Macau(科技学院电子与计算机工程系,澳门大学);Centre for Cognitive and Brain Sciences, Institute of Collaborative Innovation, University of Macau(认知与脑科学中心,创新研究院,澳门大学)
Multi-Feature Riemannian Hypergraph for Online Test-Time Adaptation of Motor Imagery Brain-Computer Interface
Peking University(北京大学);Chinese Institute for Brain Research(中国脑科学研究院);NeuCyber Neurotech(纽赛博神经科技公司);Beijing Medical University(北京医科大学);Chinese Academy of Medical Sciences & Peking Union Medical College(中国医学科学院北京协和医学院)
Computational Modeling of Human Adaptation in Urban Infrastructure Management under Extreme Conditions: A Case Study of Subway Flood Scenarios
Carnegie Mellon University(卡内基梅隆大学);Rice University(莱斯大学);The Hong Kong University of Science and Technology(香港科技大学);Hong Kong Center for Construction Robotics, The Hong Kong University of Science and Technology(香港科技大学香港建造机器人中心);The Hong Kong Polytechnic University(香港理工大学)
Continuous Behavioral Synthesis for Adaptive Health Dashboards: An LLM-Mediated Architecture Integrating Explicit Preference, Spatial Reorganization, and Attention Allocation Signals
Computational ergonomics for task delegation in Human-Robot Collaboration: spatiotemporal adaptation of the robot to the human through contactless gesture recognition
Systematic Adaptation of Communication-focused Machine Learning Models from Real to Virtual Environments for Human-Robot Collaboration
School of Engineering(工程学院);The University of British Columbia(不列颠哥伦比亚大学);Department of Aerospace Engineering(航空航天工程系);Indian Institute of Technology, Kharagpur(印度理工学院卡拉格普尔分校);Department of Mechanical Engineering(机械工程系);University of Victoria(维多利亚大学)