发表机构
Harbin Institute of Technology; Institute of Information Engineering, Chinese Academy of Sciences（哈尔滨工业大学; 中国科学院信息工程研究所）
机构由 AI 辅助整理，请以论文原文为准。AI 中文总结
针对现有设计转代码基准的局限，提出首个项目级多屏移动应用生成基准MobileForge，通过五轴评估及两种测试方法，发现前沿多模态LLM构建的应用存在导航、保真度和可维护性问题。
AI 中文摘要
近期多模态大语言模型可将视觉设计直接转换为可执行代码，但真实移动产品需多张截图才能形成具备共享组件和可用导航的可构建代码库。这种项目级场景暴露了现有设计转代码基准的三个局限：它们聚焦单页面生成而非完整代码库，无法评估跨页面导航，也不衡量项目级可维护性。我们推出MobileForge，首个面向项目级多屏移动应用生成的基准测试，包含真实移动应用、经人工审核的页面、结构化页面关系标注及导航测试规范。MobileForge支持构建、导航、视觉保真度、代码可维护性和效率的五轴评估。我们还提出状态隔离导航测试以避免导航评估中的级联失败，以及锚点参考列表式视觉评估协议以提升视觉评判可靠性。对六个前沿多模态LLM的端到端运行测试显示，当前模型可构建能编译且能到达正确页面的移动应用项目，但交互式导航仍不可靠，视觉保真度和可维护性仍有差距。该基准及配套材料可在https URL获取。
英文摘要
Recent multimodal large language models can convert visual designs directly into executable code, but real mobile products require multiple screenshots to become a buildable codebase with shared components and working navigation. This project-level setting exposes three limits of existing design-to-code benchmarks: they focus on single-page generation rather than complete codebases, cannot evaluate cross-page navigation, and do not measure project-wide maintainability. We introduce MobileForge, the first benchmark for project-level multi-screen mobile app generation, comprising real mobile apps, human-reviewed screens, structured page-relationship annotations, and navigation test specifications. MobileForge supports five-axis evaluation of build, navigation, visual fidelity, code maintainability, and efficiency. We also propose state-isolated navigation testing to avoid cascading failures in navigation evaluation and an anchor-referenced list-wise visual evaluation protocol to improve visual-judge reliability. Across end-to-end runs on six frontier multimodal LLMs, current models can build mobile-app projects that compile and reach the correct pages, but interactive navigation remains unreliable and visual fidelity and maintainability still lag. The benchmark and supporting materials are available at https://github.com/anoa12159-hue/mobileforge_eval.
CommentsAccepted by EMNLP 2026 Main
