arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2412.20071cs.HC
收藏

面向UI设计中的人机协同:利用大语言模型支持迭代式生成

Towards Human-AI Synergy in UI Design: Supporting Iterative Generation with LLMs

University of New South Wales(新南威尔士大学);Monash University(蒙纳士大学)

Mingyue Yuan, Jieshan Chen, Yongquan Hu, Sidong Feng, Mulong Xie, Gelareh Mohammadi, Zhenchang Xing, Aaron Quigley

AI总结:

针对自动化UI设计生成缺乏迭代支持的问题,本研究通过形成性研究明确需求,提出以人为本的PrototypeFlow系统,依托多模态输入与主题设计模块实现可控的迭代式高保真UI生成,经实验和用户研究验证了其有效性与实用性。

摘要:

在自动化UI设计生成领域,核心挑战之一是缺乏对迭代流程的支持,多数系统仅聚焦于端到端输出。这一问题源于设计意图解读能力有限,且中间结果的优化缺乏透明度。为深入厘清这些挑战,我们开展了一项形成性研究,明确了利用生成式工具支持迭代设计的具体可行需求。基于上述研究发现,我们提出PrototypeFlow——一套以人为本的自动化UI生成系统,该系统依托多模态输入与模型实现功能。PrototypeFlow以自然语言描述和布局偏好作为输入,生成高保真UI设计方案,其核心是主题设计模块:该模块通过提示词增强厘清隐含的设计意图,并协调各子模块完成组件级生成。设计师可完全掌控输入、中间结果与最终原型,通过引导生成过程、直接编辑输出实现灵活且有针对性的优化。我们的实验与用户研究证实了所提出的PrototypeFlow的有效性与实用价值。

英文摘要:

In automated UI design generation, a key challenge is the lack of support for iterative processes, as most systems focus solely on end-to-end output. This stems from limited capabilities in interpreting design intent and a lack of transparency for refining intermediate results. To better understand these challenges, we conducted a formative study that identified concrete and actionable requirements for supporting iterative design with Generative Tools. Guided by these findings, we propose PrototypeFlow, a human-centered system for automated UI generation that leverages multi-modal inputs and models. PrototypeFlow takes natural language descriptions and layout preferences as input to generate the high-fidelity UI design. At its core is a theme design module that clarifies implicit design intent through prompt enhancement and orchestrates sub-modules for component-level generation. Designers retain full control over inputs, intermediate results, and final prototypes, enabling flexible and targeted refinement by steering generation and directly editing outputs. Our experiments and user studies confirmed the effectiveness and usefulness of our proposed PrototypeFlow.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑