前端扩散:通过从抽象到具体的任务转换探索基于意图的用户界面
Frontend Diffusion: Exploring Intent-Based User Interfaces through Abstract-to-Detailed Task Transitions
AI总结:
本文提出Frontend Diffusion工具,通过草图、撰写、编码三阶段任务转换,从用户草图生成高质量网站,探索基于意图的界面并降低复杂任务中的人工干预与沟通成本。
摘要:
生成式人工智能的兴起正在催化用户界面从基于命令到基于意图的结果指定的范式转变。在本文中,我们在前端代码生成的背景下探索从抽象到具体的任务转换,作为迈向基于意图的用户界面的一步,旨在弥合抽象用户意图与具体实现之间的差距。我们介绍了Frontend Diffusion,一种端到端的由大语言模型驱动的工具,能够根据用户草图生成高质量网站。该系统采用三阶段任务转换过程:草图绘制、文本撰写和代码生成。我们展示了任务转换在复杂任务中减少人工干预和沟通成本的潜力。我们的工作还为在其他领域探索类似方法开辟了途径,并有可能扩展到更复杂、相互依赖的任务,例如视频制作。
英文摘要:
The emergence of Generative AI is catalyzing a paradigm shift in user interfaces from command-based to intent-based outcome specification. In this paper, we explore abstract-to-detailed task transitions in the context of frontend code generation as a step towards intent-based user interfaces, aiming to bridge the gap between abstract user intentions and concrete implementations. We introduce Frontend Diffusion, an end-to-end LLM-powered tool that generates high-quality websites from user sketches. The system employs a three-stage task transition process: sketching, writing, and coding. We demonstrate the potential of task transitions to reduce human intervention and communication costs in complex tasks. Our work also opens avenues for exploring similar approaches in other domains, potentially extending to more complex, interdependent tasks such as video production.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。