arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2511.06404cs.CV
收藏

InfoAffect: 信息传播中信息图的情感标注

InfoAffect: Affective Annotations of Infographics in Information Spread

Zihang Fu, Yunchao Wang, Chenyu Huang, Guodao Sun, Ronghua Liang

AI总结:

InfoAffect数据集通过多模态大语言模型和递归排名融合算法,实现了信息图情感标注的高准确度研究。

摘要:

信息图被广泛用于社交媒体上以传达复杂信息,但它们如何影响用户情感仍鲜有研究,这主要是由于相关数据集的缺乏。为填补这一空白,我们引入了一个包含3500个样本的情感标注InfoAffect数据集,该数据集结合了文本内容与现实中的信息图。我们首先从六个领域收集原始数据,并通过预处理、伴随文本优先方法和三种策略对齐数据,以确保质量和合规性。之后,我们构建了一个情感表来约束标注。我们使用了五个最先进的多模态大语言模型(MLLMs)来分析两种模态,其输出通过递归排名融合(RRF)算法融合,以获得稳健的情感和置信度。我们进行了两项用户研究实验来验证可用性和使用InfoAffect数据集进行评估,使用综合情感一致性指数(CACI),取得了总体得分为0.608,表明准确性高。InfoAffect数据集可在公共仓库中获取:https://github.com/bulichuchu/InfoAffect-dataset。

英文摘要:

Infographics are widely used in social media to convey complex information, yet how they influence users' affects remains underexplored due to the scarcity of relevant datasets. To address this gap, we introduce a 3.5k-sample affect-annotated InfoAffect dataset, which combines textual content with real-world infographics. We first collected the raw data from six fields and aligned it via preprocessing, the accompanied-text-priority method, and three strategies to guarantee quality and compliance. After that, we constructed an Affect Table to constrain annotation. We used five state-of-the-art multimodal large language models (MLLMs) to analyze both modalities, and their outputs were fused with the Reciprocal Rank Fusion (RRF) algorithm to yield robust affects and confidences. We conducted a user study with two experiments to validate usability and assess the InfoAffect dataset using the Composite Affect Consistency Index (CACI), achieving an overall score of 0.608, which indicates high accuracy. The InfoAffect dataset is available in a public repository at https://github.com/bulichuchu/InfoAffect-dataset.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑