SketchJudge: A Diagnostic Benchmark for Grading Hand-drawn Diagrams with Multimodal Large Language Models
SketchJudge: 一种用于用多模态大语言模型评分手绘图的诊断基准
机构 * School of Artificial Intelligence, Beijing Normal University(人工智能学院,北京师范大学)
专题命中 视觉推理 :multimodal large language model(title,abstract);分类 cs.CV、cs.AI
AI总结 SketchJudge是一个用于评估多模态大语言模型在评分手绘图任务中诊断能力的基准,通过1015份手绘学生回答验证了当前视觉-语言对齐在符号和嘈杂环境中的脆弱性。
Comments 8 pages for the main text (excluding references and the limitations section); 37 pages in total including appendices