在CTR预测中可视化和理解深度神经网络
Visualizing and Understanding Deep Neural Networks in CTR Prediction
摘要:
尽管深度学习技术已经成功应用于许多任务,但解释深度神经网络模型对我们来说仍然是一个很大的挑战。近年来,在图像处理和自然语言处理领域,对深度神经网络的机制进行了可视化和分析。在本文中,我们提出了可视化和理解深度神经网络的方法,用于非常重要的商业任务-CTR(点击率)预测。我们进行实验的生产数据,从我们的在线广告系统每天不同的分布。为了理解模型的机制和性能,我们在神经元水平上考察了模型的内部状态。此外,探针的方法来衡量逐层的模型的性能。此外,为了衡量输入特征的影响,我们根据反向传播的梯度计算显着性分数。还讨论了实际应用,例如,在理解,监测,诊断和完善模型和算法。
英文摘要:
Although deep learning techniques have been successfully applied to many tasks, interpreting deep neural network models is still a big challenge to us. Recently, many works have been done on visualizing and analyzing the mechanism of deep neural networks in the areas of image processing and natural language processing. In this paper, we present our approaches to visualize and understand deep neural networks for a very important commercial task--CTR (Click-through rate) prediction. We conduct experiments on the productive data from our online advertising system with daily varying distribution. To understand the mechanism and the performance of the model, we inspect the model's inner status at neuron level. Also, a probe approach is implemented to measure the layer-wise performance of the model. Moreover, to measure the influence from the input features, we calculate saliency scores based on the back-propagated gradients. Practical applications are also discussed, for example, in understanding, monitoring, diagnosing and refining models and algorithms.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。