arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2301.11030cs.CL
收藏

基于图像字幕的释义获取

Paraphrase Acquisition from Image Captions

Bauhaus-Universität Weimar(魏玛包豪斯大学);Friedrich-Schiller-Universität Jena(耶拿弗里德里希·席勒大学);Leipzig University(莱比锡大学)

Marcel Gohsen, Matthias Hagen, Martin Potthast, Benno Stein

摘要:

我们建议使用来自Web的图像标题作为以前未充分利用的资源进行释义(即,具有相同“消息”的文本)并创建和分析相应的数据集。当图像在Web上被重用时,通常会分配原始标题。我们假设,不同的标题为同一图像自然形成一组相互释义。为了证明这个想法的适用性,我们分析了英文维基百科中的标题,编辑经常为不同的文章重新标记相同的图像。本文介绍了底层的挖掘技术,由此产生的维基百科-IPC数据集,并比较已知的释义语料库的语法和语义的释义相似性,我们的新资源。在这种情况下,我们引入特征图沿两个相似性维度来识别来自不同来源的释义的风格。注释研究表明算法确定的特征图的高可靠性。

英文摘要:

We propose to use image captions from the Web as a previously underutilized resource for paraphrases (i.e., texts with the same "message") and to create and analyze a corresponding dataset. When an image is reused on the Web, an original caption is often assigned. We hypothesize that different captions for the same image naturally form a set of mutual paraphrases. To demonstrate the suitability of this idea, we analyze captions in the English Wikipedia, where editors frequently relabel the same image for different articles. The paper introduces the underlying mining technology, the resulting Wikipedia-IPC dataset, and compares known paraphrase corpora with respect to their syntactic and semantic paraphrase similarity to our new resource. In this context, we introduce characteristic maps along the two similarity dimensions to identify the style of paraphrases coming from different sources. An annotation study demonstrates the high reliability of the algorithmically determined characteristic maps.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑