超越翻译:基于视觉-语言模型的跨文化表情包再创作
Beyond Translation: Cross-Cultural Meme Transcreation with Vision-Language Models
AI总结:
本文提出了一种基于视觉-语言模型的跨文化表情包再创作框架,通过大规模数据集和多维度评估,揭示了跨文化再创作中的方向性差异及挑战。
摘要:
表情包是在线交流中普遍存在的一种形式,但其文化特异性对跨文化交流构成了重大挑战。我们研究了跨文化表情包再创作,这是一种多模态生成任务,旨在在适应文化特定参考的同时保留沟通意图和幽默。我们提出了一种基于视觉-语言模型的混合再创作框架,并引入了一个大规模的中英文表情包双向数据集。通过人类判断和自动化评估,我们分析了6,315对表情包,并在不同文化方向上评估再创作质量。我们的结果表明,当前的视觉-语言模型在一定程度上可以进行跨文化表情包再创作,但表现出明显的方向不对称性:美国-中国再创作的质量始终高于中国-美国。我们进一步确定了哪些幽默和视觉-文本设计方面在不同文化间可以转移,哪些仍然具有挑战性,并提出了一种评估跨文化多模态生成的框架。我们的代码和数据集可在https://github.com/AIM-SCU/MemeXGen上公开获取。
英文摘要:
Memes are a pervasive form of online communication, yet their cultural specificity poses significant challenges for cross-cultural adaptation. We study cross-cultural meme transcreation, a multimodal generation task that aims to preserve communicative intent and humor while adapting culture-specific references. We propose a hybrid transcreation framework based on vision-language models and introduce a large-scale bidirectional dataset of Chinese and US memes. Using both human judgments and automated evaluation, we analyze 6,315 meme pairs and assess transcreation quality across cultural directions. Our results show that current vision-language models can perform cross-cultural meme transcreation to a limited extent, but exhibit clear directional asymmetries: US-Chinese transcreation consistently achieves higher quality than Chinese-US. We further identify which aspects of humor and visual-textual design transfer across cultures and which remain challenging, and propose an evaluation framework for assessing cross-cultural multimodal generation. Our code and dataset are publicly available at https://github.com/AIM-SCU/MemeXGen.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。