MARLUI:面向自适应用户界面的多智能体强化学习
MARLUI: Multi-Agent Reinforcement Learning for Adaptive UIs
AI总结:
本文提出MARLUI框架,将自适应UI建模为多智能体强化学习问题,通过用户智能体与界面智能体在仿真中协同学习,无需真实用户数据即可获得可泛化到真实用户的自适应策略。
摘要:
自适应用户界面(UI)会自动改变界面以更好地支持用户任务。近年来,机器学习技术使得向更强大、更复杂的自适应UI过渡成为可能。然而,自适应用户界面的一个核心挑战是依赖必须针对每个任务离线收集的高质量用户数据。我们将UI自适应形式化为一个多智能体强化学习问题以克服这一挑战。在我们的形式化中,一个用户智能体模拟真实用户并学习与UI交互。同时,一个界面智能体学习UI自适应以最大化用户智能体的性能。界面智能体从用户智能体的行为中学习任务结构,并基于此支持用户智能体完成任务。我们的方法产生的自适应策略仅在仿真中学习,因此不需要真实用户数据。我们的实验表明,学习到的策略能够泛化到真实用户,并取得与数据驱动的监督学习基线相当的性能。
英文摘要:
Adaptive user interfaces (UIs) automatically change an interface to better support users' tasks. Recently, machine learning techniques have enabled the transition to more powerful and complex adaptive UIs. However, a core challenge for adaptive user interfaces is the reliance on high-quality user data that has to be collected offline for each task. We formulate UI adaptation as a multi-agent reinforcement learning problem to overcome this challenge. In our formulation, a user agent mimics a real user and learns to interact with a UI. Simultaneously, an interface agent learns UI adaptations to maximize the user agent's performance. The interface agent learns the task structure from the user agent's behavior and, based on that, can support the user agent in completing its task. Our method produces adaptation policies that are learned in simulation only and, therefore, does not need real user data. Our experiments show that learned policies generalize to real users and achieve on par performance with data-driven supervised learning baselines.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。