CUHK & ETHZ & SIAT参加2016年ActivityNet挑战赛
CUHK & ETHZ & SIAT Submission to ActivityNet Challenge 2016
摘要:
本文介绍了我们提交ActivityNet Challenge 2016未修剪视频分类任务的方法。我们遵循时间段网络的基本管道,并通过一些其他技术进一步提高性能。具体来说,我们使用最新的深度模型架构,例如,ResNet和Inception V3,并引入新的聚合方案(top-k和注意力加权池)。此外,我们将音频作为补充通道,通过应用于频谱图的CNN提取相关信息。通过这些技术,我们得到了一个深度模型的集合,这些模型在测试集上达到了很高的分类精度(mAP $93.23\%$),并在挑战中获得了第一名。
英文摘要:
This paper presents the method that underlies our submission to the untrimmed video classification task of ActivityNet Challenge 2016. We follow the basic pipeline of temporal segment networks and further raise the performance via a number of other techniques. Specifically, we use the latest deep model architecture, e.g., ResNet and Inception V3, and introduce new aggregation schemes (top-k and attention-weighted pooling). Additionally, we incorporate the audio as a complementary channel, extracting relevant information via a CNN applied to the spectrograms. With these techniques, we derive an ensemble of deep models, which, together, attains a high classification accuracy (mAP $93.23\%$) on the testing set and secured the first place in the challenge.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。