arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2502.21068cs.SE
收藏

GUIDE:面向自动化原型的LLM驱动GUI生成分解

GUIDE: LLM-Driven GUI Generation Decomposition for Automated Prototyping

Kristian Kolthoff, Felix Kretzer, Christian Bartelt, Alexander Maedche, Simone Paolo Ponzetto

AI总结:

针对LLM直接生成GUI原型缺乏可视化和可编辑性且修改低效的问题,提出GUIDE方法,分解需求并集成Figma,实现可控高效的自动化原型制作。

摘要:

GUI原型制作是增强需求获取、促进客户需求可视化和细化最有价值的技术之一。虽然GUI原型制作对软件开发过程有积极影响,但同时也需要大量的精力和资源。大型语言模型(LLM)的出现及其令人印象深刻的代码生成能力,为自动化GUI原型制作提供了一种有前景的方法。尽管有这些潜力,当前基于LLM的原型制作解决方案与传统基于用户的GUI原型制作方法之间存在差距,后者提供GUI原型的可视化表示和直接编辑功能。相比之下,LLM及相关生成方法仅产生文本序列或不可编辑的图像输出,缺乏上述两个方面,因此阻碍了对GUI原型制作的支持。此外,当直接使用LLM时,用户要求的微小更改通常会导致整个GUI原型的低效重新生成。在这项工作中,我们提出了GUIDE,一种新颖的LLM驱动的GUI生成分解方法,无缝集成到流行的原型制作框架Figma中。我们的方法首先将高层GUI描述分解为细粒度的GUI需求,随后将其转换为Material Design GUI原型,从而实现更高的可控性和更高效的更改适应。为了高效地进行基于提示的Material Design GUI原型生成,我们提出了一种检索增强生成方法来集成组件库。我们的初步评估证明了GUIDE在弥合LLM生成能力与传统GUI原型制作工作流之间差距方面的有效性,为LLM驱动的GUI原型制作提供了一种更有效、更可控的基于用户的方法。视频:https://youtu.be/C9RbhMxqpTU

英文摘要:

GUI prototyping serves as one of the most valuable techniques for enhancing the elicitation of requirements and facilitating the visualization and refinement of customer needs. While GUI prototyping has a positive impact on the software development process, it simultaneously demands significant effort and resources. The emergence of Large Language Models (LLMs) with their impressive code generation capabilities offers a promising approach for automating GUI prototyping. Despite their potential, there is a gap between current LLM-based prototyping solutions and traditional user-based GUI prototyping approaches which provide visual representations of the GUI prototypes and direct editing functionality. In contrast, LLMs and related generative approaches merely produce text sequences or non-editable image output, which lacks both mentioned aspects and therefore impede supporting GUI prototyping. Moreover, minor changes requested by the user typically lead to an inefficient regeneration of the entire GUI prototype when using LLMs directly. In this work, we propose GUIDE, a novel LLM-driven GUI generation decomposition approach seamlessly integrated into the popular prototyping framework Figma. Our approach initially decomposes high-level GUI descriptions into fine-granular GUI requirements, which are subsequently translated into Material Design GUI prototypes, enabling higher controllability and more efficient adaption of changes. To efficiently conduct prompting-based generation of Material Design GUI prototypes, we propose a retrieval-augmented generation approach to integrate the component library. Our preliminary evaluation demonstrates the effectiveness of GUIDE in bridging the gap between LLM generation capabilities and traditional GUI prototyping workflows, offering a more effective and controlled user-based approach to LLM-driven GUI prototyping. Video: https://youtu.be/C9RbhMxqpTU

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑