arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1904.08066cs.HCcs.CV
收藏

使用深度学习进行协作分析

Collaboration Analysis Using Deep Learning

University of Delaware(特拉华大学);Technical University of Munich(慕尼黑工业大学);Johns Hopkins University(约翰斯·霍普金斯大学)

Zhang Guo, Kevin Yu, Rebecca Pearlman, Nassir Navab, Roghayeh Barmaki

摘要:

协作学习过程的分析是教育研究领域中一个日益发展的领域,有许多不同的分析方法。在本文中,我们提供了一种新的解决方案,使用深度神经网络来改进自动协作学习分析。而不是使用自我报告的问卷,这是受偏见和噪音,我们自动提取群体工作信息的对象识别结果使用掩码R-CNN方法。该过程基于从协作学习过程的图片和视频片段中检测出人和其他对象,然后使用协作指标对移动学习性能进行评估。我们测试了我们的方法来自动评估组工作的合作,在一项对照研究的33对夫妇,同时进行解剖人体彩绘干预。结果表明,我们的方法认识到治疗组和控制组的团队在个案研究中的合作的差异。这项工作介绍了使用计算机视觉技术的人与人之间的互动自动质量预测的新方法。

英文摘要:

The analysis of the collaborative learning process is one of the growing fields of education research, which has many different analytic solutions. In this paper, we provided a new solution to improve automated collaborative learning analyses using deep neural networks. Instead of using self-reported questionnaires, which are subject to bias and noise, we automatically extract group-working information by object recognition results using Mask R-CNN method. This process is based on detecting the people and other objects from pictures and video clips of the collaborative learning process, then evaluate the mobile learning performance using the collaborative indicators. We tested our approach to automatically evaluate the group-work collaboration in a controlled study of thirty-three dyads while performing an anatomy body painting intervention. The results indicate that our approach recognizes the differences of collaborations among teams of treatment and control groups in the case study. This work introduces new methods for automated quality prediction of collaborations among human-human interactions using computer vision techniques.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑