arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.10529cs.CY
收藏

绘制你的程序:探索视觉提示与生成式AI在教学与评估中的应用

Drawing Your Programs: Exploring the Applications of Visual-Prompting with GenAI for Teaching and Assessment

Virginia Tech(弗吉尼亚理工大学);University of California, San Diego(加州大学圣地亚哥分校);University of Toronto, Mississauga(多伦多大学密西沙加分校)

David H. Smith, S. Moonwara A. Monisha, Annapurna Vadaparty, Leo Porter, Daniel Zingaro

AI总结:

本文探讨利用视觉提示与生成式AI在编程教学与评估中的应用,通过学生构建的分解图提示GPT-4.1生成代码,展示多模态提示在编程教育中的潜力。

摘要:

在设计程序时,无论是新手程序员还是经验丰富的开发者,常常会草图化——或者更著名的,在白板上阐述想法。然而,尽管引入了原生多模态生成式AI模型,关于人与生成式AI协作编程的研究仍然主要集中在文本提示上,几乎忽视了程序员自然使用的视觉和空间表示来推理和沟通设计。在本文提案和立场论文中,我们主张并提供初步证据表明,这种以文本为中心的关注忽略了其他提示生成式AI模型的形式,如问题分解图,这些图本身可以作为代码生成的提示,从而开启新的编程活动和评估类型。为了支持这一立场,我们展示了在一门大型入门级Python编程课程中的发现,其中学生构建了分解图,这些图被用来提示GPT-4.1生成代码。我们证明了当前模型在从学生构建的图中生成代码方面非常成功。最后,我们探讨了拥抱多模态提示对计算机教育的影响,特别是在评估背景下的意义。

英文摘要:

When designing a program, both novice programmers and seasoned developers alike often sketch out -- or, perhaps more famously, whiteboard -- their ideas. Yet despite the introduction of natively multimodal Generative AI models, work on Human-GenAI collaborative coding has remained overwhelmingly focused on textual prompts -- largely ignoring the visual and spatial representations that programmers naturally use to reason about and communicate their designs. In this proposal and position paper, we argue and provide tentative evidence that this text-centric focus overlooks other forms of prompting GenAI models, such as problem decomposition diagrams functioning as prompts for code generation in their own right enabling new types of programming activities and assessments. To support this position, we present findings from a large introductory Python programming course, where students constructed decomposition diagrams that were used to prompt GPT-4.1 for code generation. We demonstrate that current models are very successful in their ability to generate code from student-constructed diagrams. We conclude by exploring the implications of embracing multimodal prompting for computing education, particularly in the context of assessment.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑