GUI agents today assume a static screen, where the world is frozen between two actions. However, real interfaces such as short-video applications violate this assumption, as their content keeps playing, and a competent user must decide what to watch and for how long. We formalize this task as Living-Screen-Native GUI agents and introduce LivingScreen, the first benchmark instantiating it on short-video platforms, with a faithful browser-based environment, a three-tier task suite, and metrics that jointly score accuracy and information efficiency. Evaluating extensive frontier models, we find that none reaches the human cost-accuracy performance, and that their dominant failure mode is over- and under-observation, pointing to observation control as a missing capability axis for future GUI agents. All data and code will be available at https://github.com/BITHLP/LivingScreen.
GUI Exploration Lab: Enhancing Screen Navigation in Agents via Multi-Turn Reinforcement Learning
Beijing University of Posts and Telecommunications（北京邮电大学）；StepFun；Waseda University（早稻田大学）；Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所）
Enhancing Screen Time Identification in Children with a Multi-View Vision Language Model and Screen Time Tracker
Department of Biomedical Engineering, Stevens Institute of Technology（生物医学工程系，史蒂文斯理工学院）；Department of Computer Science, Iowa State University（计算机科学系，爱荷华州立大学）；Department of Electrical Engineering, Columbia University in the City of New York（电气工程系，哥伦比亚大学（纽约市））；Nokia Bell Labs（诺基亚贝尔实验室）；Department of Communication & Information Science, University of Alabama（传播与信息科学系，阿拉巴马大学）；Department of Psychology, University of Alabama（心理学系，阿拉巴马大学）；Department of Electrical and Computer Engineering, University of Alabama（电气与计算机工程系，阿拉巴马大学）
GUIGuard-Bench: Toward a General Evaluation for Privacy-Preserving GUI Agents
Beijing Normal University（北京师范大学）；Zhongguancun Academy（中关村学院）；University of Science and Technology of China（中国科学技术大学）；A*STAR；Zhongguancun Institution of Artificial Intelligence（中关村人工智能研究所）
GUI-CC: Benchmarking Contextual Consistency of GUI World Models as Agent Environments
Yale University（耶鲁大学）；Zhejiang University（浙江大学）；China University of Geosciences（中国地质大学）；DAMO Academy, Alibaba Group（阿里巴巴达摩院）；Tongji University（同济大学）；University of California, San Diego（加利福尼亚大学圣迭戈分校）
How Auxiliary Reasoning Unleashes GUI Grounding in VLMs
Zhejiang Lab（浙江实验室）；Hangzhou Research and Development Center（杭州研发中心）；China Mobile（中国移动）；Innovation Center of Yangtze River Delta（长江三角洲创新中心）；Zhejiang University（浙江大学）
Improving GUI Grounding with Explicit Position-to-Coordinate Mapping
ServiceNow；Mila - Quebec AI Institute（魁北克人工智能研究所）；Université de Montréal（蒙特利尔大学）；York University（约克大学）；Polytechnique Montréal（蒙特利尔理工学院）；McGill University（麦吉尔大学）
ScreenAgent: A Vision Language Model-driven Computer Control Agent
School of Artificial Intelligence, Jilin University（吉林大学人工智能学院）；Engineering Research Center of Knowledge-Driven Human-Machine Intelligence, Ministry of Education, China（教育部知识驱动人机智能工程研究中心）
