一个用于物理与抽象合理性及人类分歧来源的数据集
A Dataset for Physical and Abstract Plausibility and Sources of Human Disagreement
AI总结:
本文构建了一个基于 Wikipedia 句子、覆盖物理与抽象合理性的英语事件数据集,并通过众包标注和清洗分析揭示人类在不合理及抽象事件判断上的分歧规律。
摘要:
我们提出了一个用于英语事件物理与抽象合理性的新型数据集。基于从 Wikipedia 中提取的自然出现句子,我们融入不同程度的抽象性,并自动生成经过扰动的伪不合理事件。我们使用众包对一个经过筛选且平衡的子集进行合理性标注,并执行广泛的清洗以确保标注质量。深入的定量分析表明,标注者更倾向于合理性而非不合理性,并且在不合理事件上分歧更大。此外,我们的合理性数据集是首个在与具体性同等程度上捕捉事件抽象性的数据集,并且我们发现事件抽象性会影响合理性评分:更具体的事件参与者会引发不合理性的感知。
英文摘要:
We present a novel dataset for physical and abstract plausibility of events in English. Based on naturally occurring sentences extracted from Wikipedia, we infiltrate degrees of abstractness, and automatically generate perturbed pseudo-implausible events. We annotate a filtered and balanced subset for plausibility using crowd-sourcing, and perform extensive cleansing to ensure annotation quality. In-depth quantitative analyses indicate that annotators favor plausibility over implausibility and disagree more on implausible events. Furthermore, our plausibility dataset is the first to capture abstractness in events to the same extent as concreteness, and we find that event abstractness has an impact on plausibility ratings: more concrete event participants trigger a perception of implausibility.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。