arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2608.23727cs.HC

序数标注博弈:构念抽象如何影响众包共识

The Ordinal Annotation Game: How Construct Abstraction Shapes Crowdsourced Consensus

Kosmas Pinitas

首次发表
浏览论文内容

中文总结 AI 辅助

本文针对将序数标注分歧视为随机噪声的观点,提出序数标注博弈模型,通过两项实验发现标注构念的语义抽象会调控共识形成机制,序数分歧是结构化行为现象而非随机误差。

中文摘要 AI 辅助

实时情感标注中的标注者间分歧被广泛视为随机噪声,本文对此观点提出挑战,将序数标注建模为针对事后多数投票下内化群体先验的隐性博弈论协调过程。我们提出序数标注博弈(Ordinal Annotation Game),这是一个概念框架,其中个体努力到集体共识的映射由目标构念的语义抽象所调控。我们在两项实验中对其进行评估,两项实验使用相同的界面软件和统一的敏感性阈值:受控感官追踪研究和野外参与度研究。感官标注产生共识主导的机制,其中主动更新会强化一致性;而参与度标注则转变为努力受限的机制,更多标注会对共识产生负面影响。相同处理下的收益斜率符号发生反转,表明序数分歧是一种结构化的行为现象,而非离散化人工产物或随机误差。

英文摘要

Inter-annotator disagreement in real-time affect annotation is widely treated as stochastic noise. We challenge this view by modelling ordinal annotation as an implicit game-theoretic coordination process against an internalised population prior under a post-hoc majority vote. We present the Ordinal Annotation Game, a conceptual scaffold in which the mapping from individual effort to collective consensus is governed by the semantic abstraction of the target construct. We evaluate it across two experiments sharing identical interface software and a uniform sensitivity threshold: a controlled sensory tracking study and an in-the-wild engagement study. Sensory annotation yields a consensus-dominant regime where active updates reinforce agreement, whereas engagement annotation inverts into an effort-limited regime where more labelling penalises consensus. The payoff slope reverses sign under identical processing, showing that ordinal disagreement is a structured behavioural phenomenon, not a discretisation artefact or random error.

补充信息

↑