The paper introduces GUI-Owl-1.5, the latest native GUI agent model that features instruct/thinking variants in multiple sizes (2B/4B/8B/32B/235B) and supports a range of platforms (desktop, mobile, browser, and more) to enable cloud-edge collaboration and real-time interaction. GUI-Owl-1.5 achieves state-of-the-art results on more than 20+ GUI benchmarks on open-source models: (1) on GUI automation tasks, it obtains 56.5 on OSWorld, 71.6 on AndroidWorld, and 48.4 on WebArena; (2) on grounding tasks, it obtains 80.3 on ScreenSpotPro; (3) on tool-calling tasks, it obtains 47.6 on OSWorld-MCP, and 46.8 on MobileWorld; (4) on memory and knowledge tasks, it obtains 75.5 on GUI-Knowledge Bench. GUI-Owl-1.5 incorporates several key innovations: (1) Hybird Data Flywheel: we construct the data pipeline for UI understanding and trajectory generation based on a combination of simulated environments and cloud-based sandbox environments, in order to improve the efficiency and quality of data collection. (2) Unified Enhancement of Agent Capabilities: we use a unified thought-synthesis pipeline to enhance the model's reasoning capabilities, while placing particular emphasis on improving key agent abilities, including Tool/MCP use, memory and multi-agent adaptation; (3) Multi-platform Environment RL Scaling: We propose a new environment RL algorithm, MRPO, to address the challenges of multi-platform conflicts and the low training efficiency of long-horizon tasks. The GUI-Owl-1.5 models are open-sourced, and an online cloud-sandbox demo is available at https://github.com/X-PLUG/MobileAgent.
Nanyang Technological University(南洋理工大学);MiLM Plus, Xiaomi Inc.(小米公司);Independent Researchers(独立研究人员);Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学人工智能学院);Wuhan University(武汉大学);Xiamen University(厦门大学)
MobileDreamer: Generative Sketch World Model for GUI Agent
State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences(多模态人工智能系统国家重点实验室,自动化研究所,中国科学院);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Meituan(美团)
AgentRAE: Remote Action Execution through Notification-based Visual Backdoors against Screenshots-based Mobile GUI Agents
Nanjing University of Science and Technology(南京理工大学);Macquarie University(麦考瑞大学);Western Sydney University(西澳大学);University of Hong Kong(香港大学);CSIRO’s Data61(澳大利亚CSIRO Data61)
Building a Stable Planner: An Extended Finite State Machine Based Planning Module for Mobile GUI Agent
Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));School of Computer Science & Engineering, South China University of Technology(华南理工大学计算机科学与工程学院)
TRAMBA: A Hybrid Transformer and Mamba Architecture for Practical Audio and Bone Conduction Speech Super Resolution and Enhancement on Mobile and Wearable Platforms
Real-Time Threaded Houbara Detection and Segmentation for Wildlife Conservation using Mobile Platforms
Khalifa University Center for Autonomous Robotic Systems (KUCARS)(卡利法大学自主机器人系统中心);Khalifa University(卡利法大学);RENECO International Wildlife Consultants LLC(RENECO国际野生动物咨询公司)