人类 vs. 大语言多模态模型(LMMs):探索数字沟通中表情符号解读与使用的差异
Human vs. LMMs: Exploring the Discrepancy in Emoji Interpretation and Usage in Digital Communication
AI总结:
本研究聚焦GPT-4V等大语言多模态模型在网络互动中表情符号解读使用与人类的差异,发现差异源于人类解读主观性及模型英语中心训练的局限,存在文化偏见与非英语文化表征不足问题。
摘要:
利用大语言多模态模型(Large Multimodal Models, LMMs)模拟人类处理多模态信息时的行为,尤其是在社交媒体语境下,凭借其广泛的潜力和深远的意义引发了极大关注。表情符号作为数字沟通最独特的方面之一,在丰富且时常明确情绪与语气维度方面起着关键作用。然而,目前对于GPT-4V这类先进模型如何在网络互动的微妙语境中解读和使用表情符号,仍存在明显的认知空白。本研究旨在通过考察GPT-4V复刻人类式表情符号使用的行为,填补这一空白。研究结果显示,人类与GPT-4V的行为之间存在显著差异,这可能源于人类解读的主观性以及GPT-4V以英语为中心的训练局限性,表明存在文化偏见且非英语文化的表征不足。
英文摘要:
Leveraging Large Multimodal Models (LMMs) to simulate human behaviors when processing multimodal information, especially in the context of social media, has garnered immense interest due to its broad potential and far-reaching implications. Emojis, as one of the most unique aspects of digital communication, are pivotal in enriching and often clarifying the emotional and tonal dimensions. Yet, there is a notable gap in understanding how these advanced models, such as GPT-4V, interpret and employ emojis in the nuanced context of online interaction. This study intends to bridge this gap by examining the behavior of GPT-4V in replicating human-like use of emojis. The findings reveal a discernible discrepancy between human and GPT-4V behaviors, likely due to the subjective nature of human interpretation and the limitations of GPT-4V's English-centric training, suggesting cultural biases and inadequate representation of non-English cultures.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。