arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2012.01295cs.CLcs.CV

Generating Descriptions for Sequential Images with Local-Object Attention and Global Semantic Context Modelling

Guangdong Ocean University(广东海洋大学);University of Aberdeen(阿伯丁大学);Tianjin University of Technology(天津理工大学);Guangdong University of Technology(广东工业大学)

Jing Su, Chenghua Lin, Mian Zhou, Qingyun Dai, Haoyu Lv

英文摘要:

In this paper, we propose an end-to-end CNN-LSTM model for generating descriptions for sequential images with a local-object attention mechanism. To generate coherent descriptions, we capture global semantic context using a multi-layer perceptron, which learns the dependencies between sequential images. A paralleled LSTM network is exploited for decoding the sequence descriptions. Experimental results show that our model outperforms the baseline across three different evaluation metrics on the datasets published by Microsoft.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑