arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2005.11780cs.CVcs.MM
收藏

基于深度卷积神经网络的Bernoulli热图头部姿态估计

Deep Convolutional Neural Network-based Bernoulli Heatmap for Head Pose Estimation

Zhongxu Hu, Yang Xing, Chen Lv, Peng Hang, Jie Liu

摘要:

头部姿态估计是许多任务的关键问题,例如驾驶员注意力、疲劳检测和人类行为分析。众所周知,神经网络在处理分类问题时比回归问题更好。让网络直接输出角度值进行优化学习是一个极其非线性的过程,对损失函数的权值约束会相对较弱。本文提出了一种新的Bernoulli热图,用于从单个RGB图像中估计头部姿态。我们的方法可以实现头部区域的定位,同时估计的角度的头部。Bernoulli热图使得在没有完全连接层的情况下构造完全卷积神经网络成为可能,并为头部姿态估计的输出形式提供了新的思路。采用具有多尺度表示的深度卷积神经网络(CNN)结构来并行地维护高分辨率信息和低分辨率信息。这种结构可以保持丰富的高分辨率表示。此外,采用通道级融合,使融合权值可学习,而不是简单的等权相加。因此,估计在空间上更精确并且可能更准确。通过在公共数据集上与其他最先进的方法进行比较,实证证明了该方法的有效性。

英文摘要:

Head pose estimation is a crucial problem for many tasks, such as driver attention, fatigue detection, and human behaviour analysis. It is well known that neural networks are better at handling classification problems than regression problems. It is an extremely nonlinear process to let the network output the angle value directly for optimization learning, and the weight constraint of the loss function will be relatively weak. This paper proposes a novel Bernoulli heatmap for head pose estimation from a single RGB image. Our method can achieve the positioning of the head area while estimating the angles of the head. The Bernoulli heatmap makes it possible to construct fully convolutional neural networks without fully connected layers and provides a new idea for the output form of head pose estimation. A deep convolutional neural network (CNN) structure with multiscale representations is adopted to maintain high-resolution information and low-resolution information in parallel. This kind of structure can maintain rich, high-resolution representations. In addition, channelwise fusion is adopted to make the fusion weights learnable instead of simple addition with equal weights. As a result, the estimation is spatially more precise and potentially more accurate. The effectiveness of the proposed method is empirically demonstrated by comparing it with other state-of-the-art methods on public datasets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑