具有生成式与演进式任务驱动数据模型的生成式与可塑性用户界面
Generative and Malleable User Interfaces with Generative and Evolving Task-Driven Data Model
AI总结:
提出以任务驱动数据模型为基础,利用AI解释用户提示生成数据模型并映射至UI规范,创建支持自然语言与直接操作修改的生成式与可塑性用户界面,技术评估与用户评估证明了其可行性与有效性。
摘要:
与静态且僵化的用户界面不同,生成式与可塑性用户界面能够响应多样化的用户目标和任务。然而,当前方法主要依赖生成代码,使得最终用户难以根据其不断演进的需求迭代地定制生成的界面。我们提出采用任务驱动数据模型——表示信息任务中的基本信息实体、关系和数据——作为UI生成的基础。我们利用AI解释用户的提示词并生成描述用户预期任务的数据模型,通过将数据模型与UI规范映射,我们可以创建生成式用户界面。最终用户可以通过自然语言和直接操作轻松修改和扩展界面,这些交互被转化为底层模型的变化。对我们方法的技术评估以及对所开发系统的用户评估,证明了所提出的生成式与可塑性UI的可行性与有效性。
英文摘要:
Unlike static and rigid user interfaces, generative and malleable user interfaces offer the potential to respond to diverse users' goals and tasks. However, current approaches primarily rely on generating code, making it difficult for end-users to iteratively tailor the generated interface to their evolving needs. We propose employing task-driven data models-representing the essential information entities, relationships, and data within information tasks-as the foundation for UI generation. We leverage AI to interpret users' prompts and generate the data models that describe users' intended tasks, and by mapping the data models with UI specifications, we can create generative user interfaces. End-users can easily modify and extend the interfaces via natural language and direct manipulation, with these interactions translated into changes in the underlying model. The technical evaluation of our approach and user evaluation of the developed system demonstrate the feasibility and effectiveness of the proposed generative and malleable UIs.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。