arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2601.00765cs.HC
收藏

透明度对学生对AI评分系统看法的影响

The Effect of Transparency on Students' Perceptions of AI Graders

University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Utah State University(犹他州立大学)

Joslyn Orgill, Andra Rice, Max Fowler, Seth Poulsen

AI总结:

本研究探讨透明度如何影响学生对AI评分系统的看法,发现透明度提升了学生对评分准确性的感知,但未显著提高学生接受评分的意愿。

摘要:

有效自动评分系统的发展对于扩大评估和反馈至关重要。尽管基于NLP的自动评分系统在处理开放性回答问题时已被发现能提供即时反馈,但自动评分系统并不总是受到学生的喜爱、理解或信任。我们的研究测试了透明度对学生对自动评分系统态度的影响。透明的自动评分系统提高了学生对自动评分系统准确性的感知以及他们在调查评论中讨论自动评分系统的意愿,但与无透明度的对照组相比,它并未改善其他相关态度——例如在测试中接受它们评分的意愿。然而,这种影响可能是因为本研究中学生对自动评分系统的信任度比该领域先前研究中的更高。我们简要讨论了这种趋势的可能原因。

英文摘要:

The development of effective autograders is key for scaling assessment and feedback. While NLP based autograding systems for open-ended response questions have been found to be beneficial for providing immediate feedback, autograders are not always liked, understood, or trusted by students. Our research tested the effect of transparency on students' attitudes towards autograders. Transparent autograders increased students' perceptions of autograder accuracy and willingness to discuss autograders in survey comments, but did not improve other related attitudes -- such as willingness to be graded by them on a test -- relative to the control without transparency. However, this lack of impact may be due to higher measured student trust towards autograders in this study than in prior work in the field. We briefly discuss possible reasons for this trend.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑