大学讲座录音中教学活动的多模态分类
Multimodal Classification of Teaching Activities from University Lecture Recordings
AI总结:
针对在线教学中学生难以定位课程关键片段的问题,提出一种利用Transformer模型融合音频与转录特征的多模态分类算法,以识别教师教学活动类型。
摘要:
由于全球疫情形势,在线高等教育的方式发生了巨大变化。教学以远程方式进行,教师将讲座音频录音作为教学材料的一部分。这种新的在线教学-学习环境对大学课堂产生了很大影响。虽然过去两年中丰富虚拟教室的在线教学技术层出不穷,但在支持学生在线学习方面却并非如此。为了克服这一局限,我们的目标是努力使学生能够轻松访问课程录音中教师讲解理论概念、解答练习或评论课程组织问题的片段。为此,我们提出了一种多模态分类算法,该算法利用基于Transformer的语言模型,通过音频文件和自动讲座转录的特征,识别课程中任何时刻正在进行的活动类型。实验结果表明,某些学术活动更容易通过音频信号识别,而其他活动则需要借助文本转录。总而言之,我们的贡献旨在识别教师在课程中的学术活动。
英文摘要:
The way of understanding online higher education has greatly changed due to the worldwide pandemic situation. Teaching is undertaken remotely, and the faculty incorporate lecture audio recordings as part of the teaching material. This new online teaching-learning setting has largely impacted university classes. While online teaching technology that enriches virtual classrooms has been abundant over the past two years, the same has not occurred in supporting students during online learning. {To overcome this limitation, our aim is to work toward enabling students to easily access the piece of the lesson recording in which the teacher explains a theoretical concept, solves an exercise, or comments on organizational issues of the course. To that end, we present a multimodal classification algorithm that identifies the type of activity that is being carried out at any time of the lesson by using a transformer-based language model that exploits features from the audio file and from the automated lecture transcription. The experimental results will show that some academic activities are more easily identifiable with the audio signal while resorting to the text transcription is needed to identify others. All in all, our contribution aims to recognize the academic activities of a teacher during a lesson.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。