In classroom teaching, student behavior can reflect their learning state and classroom participation, which is of great significance for teaching quality analysis. To address the problems of dense student targets, numerous small objects, frequent occlusions, and imbalanced class distribution in real classroom scenes, this paper proposes an improved student classroom behavior recognition model named ALC-YOLOv8s based on YOLOv8s. The model introduces SPPF-LSKA to enhance contextual feature extraction, employs CFC-CRB and SFC-G2 to optimize multi-scale feature fusion, and incorporates ATFLoss to improve the learning ability for minority classes and hard samples. Experimental results show that compared with the baseline model, the improved model achieves increases of 1.8% in mAP50 and 2.1% in mAP50-95. Compared with several mainstream detection methods, the proposed model can well meet the requirements of automatic student behavior recognition in complex classroom scenarios.
Learning Behavior Recognition in Smart Classroom with Multiple Students Based on YOLOv5
Hubei University of Technology(湖北工业大学);Central China Normal University(华中师范大学)
基于深度学习的计算机视觉技术近年来发展壮大,利用计算机视觉技术的交叉施肥是近年来的热门方向。利用计算机视觉技术识别学生在课堂上的学习行为,可以减少传统教师在课堂上监督学生的工作量,并确保更大的准确性和全面性。然而,现有的学生学习行为检测系统无法精确地跟踪和检测多个目标,学习行为识别的准确率不高,无法满足当前对学生课堂行为准确识别的需求。针对这一问题,本文提出了一种基于YOLO(you only look once)算法的YOLOv5s网络结构来识别和分析学生的课堂行为。首先,对智能教室中拍摄的输入图像进行预处理。然后,将预处理后的图像输入到设计的YOLOv5网络中,通过卷积层提取深度特征,并应用挤压和激励(SE)注意力检测机制来降低识别过程中背景信息的权重。最后,提取的特征进行分类的特征金字塔网络(FPN)和路径聚合网络(PAN)结构。通过多组实验与传统的学习行为识别方法进行比较,验证了该方法的有效性。与YOLOv4相比,该方法能够将mAP性能提高11%。
Multi-Scale Deformable Transformers for Student Learning Behavior Detection in Smart Classroom
Central China Normal University(华中师范大学);CCNU Wollongong Joint Institute, Central China Normal University(华中师范大学伍伦贡联合研究院);Hubei University of Technology(湖北工业大学)
Towards Student Actions in Classroom Scenes: New Dataset and Baseline
School of Communications and Information Engineering, Chongqing University of Posts and Telecommunications(重庆邮电大学通信与信息工程学院);School of Intelligent Systems Engineering, Shenzhen Campus of Sun Yat-sen University(中山大学深圳校区智能系统工程学院)
Classroom-Inspired Multi-Mentor Distillation with Adaptive Learning Strategies
Rhineland-Palatinate Technical University of Kaiserslautern (RPTU)(莱茵兰-普法尔茨州 Kaiserslautern 工业大学(RPTU));German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心(DFKI))