arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.03207cs.CVcs.CE
收藏

利用大型多模态模型识别石材劣化模式

Identification of Stone Deterioration Patterns with Large Multimodal Models

Daniele Corradetti, Jose Delgado Rodrigues

AI总结:

本文系统评估了GPT-4omni等大型多模态基础模型对354张代表性石质遗产图像中石材劣化模式与异常的识别分类能力,揭示了其在遗产保护与修复领域的优势与弱点。

摘要:

保护石材文化遗产地是保存文化和历史地标的关键关注点。随着大型多模态模型的出现,如GPT-4omni(OpenAI)、Claude 3 Opus(Anthropic)和Gemini 1.5 Pro(Google),定义这些模型的操作能力变得越来越重要。在这项工作中,我们系统地评估了主要基础多模态模型识别和分类石材元素异常与劣化模式的能力,这些能力在世界遗产的保护和修复实践中非常有用。在定义了主要石材劣化模式和异常的分类体系后,我们要求基础模型对精选的354张具有高度代表性的石质遗产图像进行识别,并为它们提供了精心挑选的标签供其选择。结果因模式类型而异,使我们能够识别出这些模型在遗产保护和修复领域的优势与弱点。

英文摘要:

The conservation of stone-based cultural heritage sites is a critical concern for preserving cultural and historical landmarks. With the advent of Large Multimodal Models, as GPT-4omni (OpenAI), Claude 3 Opus (Anthropic) and Gemini 1.5 Pro (Google), it is becoming increasingly important to define the operational capabilities of these models. In this work, we systematically evaluate the abilities of the main foundational multimodal models to recognise and classify anomalies and deterioration patterns of the stone elements that are useful in the practice of conservation and restoration of world heritage. After defining a taxonomy of the main stone deterioration patterns and anomalies, we asked the foundational models to identify a curated selection of 354 highly representative images of stone-built heritage, offering them a careful selection of labels to choose from. The result, which varies depending on the type of pattern, allowed us to identify the strengths and weaknesses of these models in the field of heritage conservation and restoration.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑