基于WordNet的图像标注与检索
Labeling and Retrieval of Emotionally-Annotated Images using WordNet
摘要:
具有语义和情感内容描述的图像库在情感计算和人机交互等许多领域都是有价值的工具,但它们在多模态可搜索在线数据库的开发中也很重要。越来越多的图像文件在互联网上不断激励研究更好的注释模型和更有效的检索方法,使用混搭的语义,场景,对象,事件,上下文和情感的可用数据。这种高级语义的形式化知识表示需要丰富的、明确的、人类的但也是机器可处理的信息。为了实现这些目标,我们提出了一个在线的基于本体的图像注释工具WNTags,并证明其有用的知识表示和图像检索使用国际情感图片系统数据库。WNTags使用WordNet作为图像标记词汇表,但认为建议的上层合并本体作为首选的上层标记形式主义。使用节点距离度量来执行检索,以建立查询与描述高级图像语义的协作加权标签之间的语义相关性,之后根据导出的重要性对结果进行排名。我们还详细说明计划,以改善WNTags创建一个基于Web的多媒体库,研究人类的情感和注意力。
英文摘要:
Repositories of images with semantic and emotion content descriptions are valuable tools in many areas such as Affective Computing and Human-Computer Interaction, but they are also important in the development of multimodal searchable online databases. Ever growing number of image documents available on the Internet continuously motivates research of better annotation models and more efficient retrieval methods which use mash-up of available data on semantics, scenes, objects, events, context and emotion. Formal knowledge representation of such high-level semantics requires rich, explicit, human but also machine-processable information. To achieve these goals we present an online ontology-based image annotation tool WNtags and demonstrate its usefulness in knowledge representation and image retrieval using the International Affective Picture System database. The WNtags uses WordNet as image tagging glossary but considers Suggested Upper Merged Ontology as the preferred upper labeling formalism. The retrieval is performed using node distance metrics to establish semantic relatedness between a query and the collaboratively weighted tags describing high-level image semantics, after which the result is ranked according to the derived importance. We also elaborate plans to improve the WNtags to create a collaborative Web-based multimedia repository for research in human emotion and attention.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。