arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.12151cs.AIcs.CLcs.CVcs.LG
收藏

将大语言模型的领域特定内容融合到知识图谱中以增强零样本物体状态分类

Fusing Domain-Specific Content from Large Language Models into Knowledge Graphs for Enhanced Zero Shot Object State Classification

University of Crete(克里特大学);Hellenic Mediterranean University(希腊地中海大学);Foundation for Research and Technology Hellas(希腊研究与技术基金会)

Filippos Gouidis, Katerina Papantoniou, Konstantinos Papoutsakis, Theodore Patkos, Antonis Argyros, Dimitris Plexousakis

AI总结:

针对领域知识生成成本高的问题,本研究将大语言模型集成到结合知识图谱与预训练语义向量的流水线中,用于零样本物体状态分类,经消融实验和对比验证,实现了当前最优性能。

摘要:

领域特定知识可显著助力解决各类视觉任务,但生成此类知识需要耗费大量人力与时间成本。本研究探究了大语言模型(LLMs)通过语义嵌入生成并提供领域特定信息的潜力。为此,在基于视觉的零样本物体状态分类任务场景下,将一个LLM集成到一个利用知识图谱和预训练语义向量的流水线中。我们通过广泛的消融实验深入检验了该LLM的表现。研究结果表明,基于LLM的嵌入与通用预训练嵌入相结合,可带来显著的性能提升。基于该消融实验的结论,我们与同类模型开展了对比分析,凸显了所提方法取得的当前最优性能。

英文摘要:

Domain-specific knowledge can significantly contribute to addressing a wide variety of vision tasks. However, the generation of such knowledge entails considerable human labor and time costs. This study investigates the potential of Large Language Models (LLMs) in generating and providing domain-specific information through semantic embeddings. To achieve this, an LLM is integrated into a pipeline that utilizes Knowledge Graphs and pre-trained semantic vectors in the context of the Vision-based Zero-shot Object State Classification task. We thoroughly examine the behavior of the LLM through an extensive ablation study. Our findings reveal that the integration of LLM-based embeddings, in combination with general-purpose pre-trained embeddings, leads to substantial performance improvements. Drawing insights from this ablation study, we conduct a comparative analysis against competing models, thereby highlighting the state-of-the-art performance achieved by the proposed approach.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑