Improving Student Learning with Hybrid Human-AI Tutoring: A Three-Study Quasi-Experimental Investigation
Danielle R. Thomas, Jionghao Lin, Erin Gatz, Ashish Gurung, Shivang Gupta, Kole Norberg, Stephen E. Fancsali, Vincent Aleven, Lee Branstetter, Emma Brunskill, Kenneth R. Koedinger
Artificial intelligence (AI) applications to support human tutoring have potential to significantly improve learning outcomes, but engagement issues persist, especially among students from low-income backgrounds. We introduce an AI-assisted tutoring model that combines human and AI tutoring and hypothesize that this synergy will have positive impacts on learning processes. To investigate this hypothesis, we conduct a three-study quasi-experiment across three urban and low-income middle schools: 1) 125 students in a Pennsylvania school; 2) 385 students (50% Latinx) in a California school; and 3) 75 students (100% Black) in a Pennsylvania charter school, all implementing analogous tutoring models. We compare learning analytics of students engaged in human-AI tutoring compared to students using math software only. We find human-AI tutoring has positive effects, particularly in student's proficiency and usage, with evidence suggesting lower achieving students may benefit more compared to higher achieving students. We illustrate the use of quasi-experimental methods adapted to the particulars of different schools and data-availability contexts so as to achieve the rapid data-driven iteration needed to guide an inspired creation into effective innovation. Future work focuses on improving the tutor dashboard and optimizing tutor-student ratios, while maintaining annual costs per students of approximately $700 annually.
Do intelligent tutoring systems benefit K-12 students? A meta-analysis and evaluation of heterogeneity of treatment effects in the U.S
University of Florida(佛罗里达大学);University of Tennessee Knoxville(田纳西大学诺克斯维尔分校);Harvard University(哈佛大学);University of Michigan, Ann Arbor(密歇根大学安娜堡分校);Florida State University(佛罗里达州立大学)
Predicting Student Actions in a Procedural Training Environment
ETS de Ingenieros Informáticos, UPM(马德里理工大学信息工程学院);E.T.S.I. Forestal y del Medio Natural, UPM(马德里理工大学森林与自然遗产高等工学院);Center for Plant Biotechnology and Genomics, UPM-INIA(马德里理工大学-西班牙国家农业研究中心植物生物技术与基因组学中心)
Leveraging Large Language Model and Story-Based Gamification in Intelligent Tutoring System to Scaffold Introductory Programming Courses: A Design-Based Research Study
Improving prediction of students' performance in intelligent tutoring systems using attribute selection and ensembles of different multimodal data sources
Pontifical Catholic University of Ecuador(厄瓜多尔天主教大学);University of Oviedo(奥维耶多大学);University of Central Florida(中佛罗里达大学);University of Córdoba(科尔多瓦大学)
Leveraging Affect Transfer Learning for Behavior Prediction in an Intelligent Tutoring System
Boston University(波士顿大学);University of Massachusetts Amherst(马萨诸塞大学阿默斯特分校);Affectiva(Affectiva公司);Clark University(克拉克大学);Worcester Polytechnic Institute(伍斯特理工学院);University of Washington(华盛顿大学)
在这项工作中,我们提出了一个基于视频的迁移学习的方法来预测问题的学生与智能教学系统(ITS)的工作成果。通过分析一个学生的脸和手势,我们的方法预测的结果,一个学生回答一个问题,在ITS从视频饲料。我们的工作是出于这样的推理,即预测这种结果的能力使辅导系统能够调整干预措施,如提示和鼓励,并最终提高学生的学习。我们收集了一个大的学生互动的标记数据集与智能在线数学导师组成的68个会话,其中54个学生解决了2,749个问题。该数据集是公开的,可在https://www.cs.bu.edu/faculty/betke/research/learning/上获得。使用这个数据集,我们的迁移学习挑战是在“野外”获得的图片的源域中设计一个表示,用于面部表情分析任务,并将此学习的表示转移到教室环境中学生的网络摄像头视频域中的人类行为预测任务。我们开发了一种新的面部影响表示和用户个性化的培训计划,解锁这种表示的潜力。我们设计了一个递归神经网络的几个变体,该网络对学生解决数学问题的视频序列的时间结构进行建模。我们的最终模型名为ATL-BP for Affect迁移学习for Behavior Prediction,在这个新数据集上,平均F分数比最先进的方法相对增加了50%。