arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.09760cs.CVcs.AI
收藏

ICCV23视觉对话情感解释挑战赛:SEU_309团队技术报告

ICCV23 Visual-Dialog Emotion Explanation Challenge: SEU_309 Team Technical Report

Columbia University(哥伦比亚大学);Southeast University(东南大学)

Yixiao Yuan, Yingzhe Peng

AI总结:

本研究针对ICCV23视觉对话情感解释挑战赛任务,结合LM与LVLM等前沿多模态模型生成艺术讨论中的情感解释,性能超越现有基准并夺冠,推进了对艺术情感影响的研究。

摘要:

基于视觉对话的情感解释生成挑战赛聚焦于在艺术讨论中通过视觉-对话交互生成情感解释。我们的方法结合了包括语言模型(LM)和大视觉语言模型(LVLM)在内的前沿多模态模型,以实现优异性能。通过利用这些模型,我们的表现优于现有基准,在ICCV23基于视觉对话的情感解释生成挑战赛中获得第一名,该赛事是第五届“视觉与语言闭环”研讨会(CLCV)的组成部分,我们在F1和BLEU指标上取得了显著分数。我们的方法展现出生成准确情感解释的卓越能力,推进了我们对艺术中情感影响的理解。

英文摘要:

The Visual-Dialog Based Emotion Explanation Generation Challenge focuses on generating emotion explanations through visual-dialog interactions in art discussions. Our approach combines state-of-the-art multi-modal models, including Language Model (LM) and Large Vision Language Model (LVLM), to achieve superior performance. By leveraging these models, we outperform existing benchmarks, securing the top rank in the ICCV23 Visual-Dialog Based Emotion Explanation Generation Challenge, which is part of the 5th Workshop On Closing The Loop Between Vision And Language (CLCV) with significant scores in F1 and BLEU metrics. Our method demonstrates exceptional ability in generating accurate emotion explanations, advancing our understanding of emotional impacts in art.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑