用于建筑危险分类的脑启发迁移学习
Brain informed transfer learning for categorizing construction hazards
AI总结:
针对建筑危险分类,本文提出利用EEG脑电信号预训练CNN并结合场景图像微调的脑启发迁移学习方法,三分类准确率较随机初始化提升9%。
摘要:
本文提出一种迁移学习范式,用于在人脑与卷积神经网络(CNN)之间迁移“知识”,以完成建筑危险分类任务。参与者观看与CNN相同的图像(目标数据集)时,研究人员通过脑电图(EEG)测量记录其大脑活动。CNN先在EEG数据上进行预训练,随后在建筑场景图像上进行微调。结果表明,在三分类任务中,与具有相同架构但参数随机初始化的网络相比,经EEG预训练的CNN准确率提高了9%。来自左额叶皮层的大脑活动表现出最高的性能提升,从而表明危险识别过程中存在高级认知加工。本工作朝着通过利用市售脑机接口记录的人脑信号进行学习、从而改进机器学习算法的方向迈出了一步。基于这种“让人保持在回路中”的方法,可以有效开发更具泛化能力的视觉识别系统。
英文摘要:
A transfer learning paradigm is proposed for "knowledge" transfer between the human brain and convolutional neural network (CNN) for a construction hazard categorization task. Participants' brain activities are recorded using electroencephalogram (EEG) measurements when viewing the same images (target dataset) as the CNN. The CNN is pretrained on the EEG data and then fine-tuned on the construction scene images. The results reveal that the EEG-pretrained CNN achieves a 9 % higher accuracy compared with a network with same architecture but randomly initialized parameters on a three-class classification task. Brain activity from the left frontal cortex exhibits the highest performance gains, thus indicating high-level cognitive processing during hazard recognition. This work is a step toward improving machine learning algorithms by learning from human-brain signals recorded via a commercially available brain-computer interface. More generalized visual recognition systems can be effectively developed based on this approach of "keep human in the loop".
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。