arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2502.18734cs.CVcs.CL

超越RNN:基于注意力机制的图像描述模型的基准测试

Beyond RNNs: Benchmarking Attention-Based Image Captioning Models

New York University(纽约大学)

Hemanth Teja Yanambakkam, Rahul Chinthala

AI总结:

本研究在MS-COCO数据集上基准测试了基于注意力机制的图像描述模型,证明其相比RNN能生成更准确、语义更丰富的描述,并提升与人工评估的对齐性。

摘要:

图像描述是一项位于计算机视觉与自然语言处理交叉领域的挑战性任务,要求模型生成对图像的有意义的文本描述。传统方法依赖于循环神经网络(RNN),但近期注意力机制的进展已展现出显著的改进。本研究使用MS-COCO数据集,对基于注意力机制的图像描述模型与基于RNN的方法进行了基准测试。我们评估了Bahdanau注意力在增强图像特征与生成描述之间对齐方面的有效性。模型使用BLEU、METEOR、GLEU和WER等自然语言处理指标进行评估。结果表明,基于注意力的模型在生成更准确且语义更丰富的描述方面优于RNN,并且与人工评估的对齐性更好。这项工作提供了关于注意力机制在图像描述中影响的见解,并指出了未来改进的方向。

英文摘要:

Image captioning is a challenging task at the intersection of computer vision and natural language processing, requiring models to generate meaningful textual descriptions of images. Traditional approaches rely on recurrent neural networks (RNNs), but recent advancements in attention mechanisms have demonstrated significant improvements. This study benchmarks the performance of attention-based image captioning models against RNN-based approaches using the MS-COCO dataset. We evaluate the effectiveness of Bahdanau attention in enhancing the alignment between image features and generated captions. The models are assessed using natural language processing metrics such as BLEU, METEOR, GLEU, and WER. Our results show that attention-based models outperform RNNs in generating more accurate and semantically rich captions, with better alignment to human evaluation. This work provides insights into the impact of attention mechanisms in image captioning and highlights areas for future improvements.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑