arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2606.03095cs.HC
收藏

AI辅助自由裁量工作:在高等教育中增加反馈提供

AI Assistance for Discretionary Work: Increasing Feedback Provision in Higher Education

Princeton University(普林斯顿大学)

Romina Mahinpei, Victoria Dean, Ruth Fong, Lydia T. Liu, Manoel Horta Ribeiro

AI总结:

通过随机实验和定性访谈,研究AI辅助草稿如何提高助教在高等教育中提供个性化反馈的参与度,发现AI草稿显著增加反馈提供量和长度,且不降低学生评价或效率。

摘要:

AI系统通过生成用户可以采用、修改或忽略的中间产物,日益塑造人类工作流程。虽然先前研究表明AI辅助可以提高必要任务的效率和准确性,但关于它是否能增加用户通常意图执行但经常跳过的自由裁量但有益工作的参与度,我们知之甚少。我们在高等教育中的个性化反馈提供背景下研究这一问题,这是一项具有教学价值但通常是可选的做法。我们进行了一项混合方法研究,结合随机现场实验和定性访谈,在一门300级机器学习课程中,有n=11名助教和n=88名学生。学生提交被随机分配到(1)处理条件,助教在评分后收到AI辅助的反馈草稿,或(2)无草稿的控制条件。助教保持完全控制,可以自行使用、编辑或忽略草稿。我们发现AI辅助反馈显著增加了反馈提供(+10.8个百分点,SE=1.1,p<0.001)和反馈长度(+39.8字符,SE=3.45,p<0.001),而没有对学生有用性评级产生负面影响或减少每字符时间。定性发现表明,AI辅助草稿作为可编辑的支架,降低了启动反馈的障碍,而不是减少总体努力。我们的发现突显了AI在自由裁量但有益任务中的前景:增加可能被忽略的工作,同时保留人类对最终结果的控制。

英文摘要:

AI assistance can increase the efficiency and accuracy of human work, but can it also encourage people to undertake valuable tasks they might otherwise skip? Here, we investigate whether AI assistance can improve participation in discretionary but beneficial work in the context of personalized feedback provision in higher education, a pedagogically valuable but often optional practice. We conduct a mixed-methods study combining a randomized field experiment and qualitative interviews in an upper-level machine learning course with $n$=11 teaching assistants (TAs) and n=88 students. Student submissions were randomly assigned to either (1) a treatment condition where TAs received AI-assisted feedback drafts after grading or (2) a control condition without drafts. We find that AI-assisted feedback significantly increases feedback provision (+10.8 percentage points, SE=1.1, p<0.001) and feedback length (+39.8 chars, SE=3.45, p<0.001) while also maintaining student-rated usefulness and expert-rated feedback quality among the feedback instances for which these outcomes were observed. While time spent conditional on providing feedback did not significantly differ between conditions, total time spent in the feedback stage increased in the treatment condition (10.55 seconds, SE=4.19, p=.012). Qualitative findings suggest that AI-assisted drafts function as editable scaffolds that lower barriers to initiating feedback rather than reducing overall labor. Together, our findings show that AI assistance can increase participation in discretionary communication without necessarily reducing the labor involved or eliminating the effort required to sustain it.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑