文本到自动机图:比较TikZ代码生成与直接图像合成
Text to Automata Diagrams: Comparing TikZ Code Generation with Direct Image Synthesis
AI总结:
本研究比较了通过视觉-语言模型生成TikZ代码与直接图像合成在生成自动机图描述中的效果,发现人工修正能显著提高生成准确性。
摘要:
图表在计算机科学课程教学中被广泛应用,在自动机与形式语言、数据结构等科目中尤为有用。这些图表通常由学生在考试或作业中绘制,其结构、布局和正确性各不相同。本研究探讨当前视觉-语言和大语言模型是否能处理此类图表并生成准确的文本和数字表示。本研究使用扫描的学生手绘图表作为输入。然后,通过视觉-语言模型从这些图像生成文本描述。这些描述由人类评审员检查并修订以确保准确性。生成的和修订后的描述随后被输入到大型语言模型中以生成TikZ代码。生成的图表被编译,然后与原始扫描图表进行比较。我们发现直接从图像生成的描述往往不正确,而人类修正可以显著提高视觉语言模型生成描述的质量。这项研究可通过为自动评分和反馈开辟道路以及创造更易获取的教学材料来帮助计算机科学教育。
英文摘要:
Diagrams are widely used in teaching computer science courses. They are useful in subjects such as automata and formal languages, data structures, etc. These diagrams, often drawn by students during exams or assignments, vary in structure, layout, and correctness. This study examines whether current vision-language and large language models can process such diagrams and produce accurate textual and digital representations. In this study, scanned student-drawn diagrams are used as input. Then, textual descriptions are generated from these images using a vision-language model. The descriptions are checked and revised by human reviewers to make them accurate. Both the generated and the revised descriptions are then fed to a large language model to generate TikZ code. The resulting diagrams are compiled and then evaluated against the original scanned diagrams. We found descriptions generated directly from images using vision-language models are often incorrect and human correction can substantially improve the quality of vision language model generated descriptions. This research can help computer science education by paving the way for automated grading and feedback and creating more accessible instructional materials.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。