AI 中文总结
研究人工智能从应用程序原型生成待办事项列表的效果，提出多模态方法，评估三种提示策略，发现结合架构上下文的混合提示有帮助，结果因项目类型而异，还提出新度量，强调开发人员监督必要。
AI 中文摘要
创建冲刺待办事项列表需要付出巨大努力，因为诸如史诗级任务、用户故事和任务等事项可能会被遗漏或指定不一致。我们提出了一种多模态方法，以支持从可视化应用程序原型生成待办事项列表，这是项目早期阶段可用的工件。我们在GPT-4上评估了三种提示策略：零样本基线、用于视觉语言推理的组合思维链（CCoT）和角色驱动提示。我们研究了两个国家的七个应用程序开发项目，并就结果采访了开发人员。总体而言，我们观察到基线提示更注重召回率而非精确率，而CCoT更为平衡，史诗级任务和用户故事的平均F1分数达到52%-66%。准确生成任务更具挑战性。添加架构上下文时，精确率提升最为一致，特别是对于后端任务（精确率提升高达35%）。对开发人员的采访显示，高达26%的误报仍被认为有用，这反映了待办事项列表创建的创造性和开放性。为了捕捉这一点，我们提出了一种名为修订召回率的新度量，它用开发人员评估补充了地面真值评估。我们的研究结果表明，结合架构上下文的混合提示可以帮助从早期原型生成待办事项列表，尽管结果因项目类型而异，开发人员监督仍然必要。
英文摘要
Creating sprint backlogs requires considerable effort, as items such as epics, user stories, and tasks can be missed or inconsistently specified. We propose a multimodal approach to support backlog generation from visual app mockups, an artifact available at early project stages. We evaluate three prompting strategies on GPT-4o: a zero-shot baseline, Compositional Chain-of-Thought (CCoT) for vision-language reasoning, and a persona-driven prompt. We study seven app development projects across two countries and interview developers about the results. Overall, we observed that the baseline prompt favours recall over precision, whereas CCoT is more balanced, achieving average F1 scores of 52-66% for epics and user stories. Tasks were more challenging to generate accurately. Precision gains were most consistent when adding architectural context, particularly for backend tasks (precision gains up to 35%). Interviews with developers revealed that up to 26% of false positives were still considered useful, reflecting the creative and open-ended nature of backlog creation. To capture this, we propose a new measure called Revised Recall, which complements ground-truth evaluation with developer assessments. Our findings suggest that hybrid prompting with architectural context can assist backlog generation from early mockups, though results vary by item type and developer oversight remains necessary.
CommentsAccepted at the AIRE Workshop, IEEE 34th International Requirements Engineering Conference (RE) 2026
