发表机构
Delft University of Technology; University of Greenwich; Instituto Tecnológico de Costa Rica; University of Hamburg; Imperial College London; University of Michigan Ann Arbor(代尔夫特理工大学; 格林威治大学; 哥斯达黎加技术学院; 汉堡大学; 帝国理工学院; 密歇根大学安娜堡分校)
机构由 AI 辅助整理,请以论文原文为准。AI 中文总结
COSI-Lab构建了含32名学者的会议多模态数据集,提出表观意图推理任务及相关标注、分析、基准等贡献,助力智能系统处理主观感知。
AI 中文摘要
COSI-Lab提供了一个多模态、多传感器的数据集,涵盖了一场国际会议中包含32名学者的跨学科学术研讨会,记录了在弱脚本化场景下具有生态效度的社会互动,该场景包含两场各30分钟的交流环节,对参与的参与者具有真实的职业和社会影响。我们认为,未来的智能系统若将主观感知的多样性视为可解释的视角驱动推理过程而非标签噪声,将能更好地处理这类感知。我们聚焦于由场外观察者确定的表观意图推理(AII)问题,并将意图概念化为与可观测的未来结果无关。我们的贡献包括:1. 针对AII的新型标注流程,该流程考虑了感知者自身的解释倾向;2. 对意图叙事在多样性、落地性和合理性方面的定量与定性分析;3. AII及相关上下文因素(如社会参与度)的基准任务;4. 所有参与者的语音质量音频及隐私保护型多模态数据,支持词汇与非语言行为分析;5. 将每位参与者自我报告的目标(30分钟至3小时)与标注的AII(秒级)进行关联。
英文摘要
COSI-Lab presents a multimodal, multi-sensor dataset of an interdisciplinary scientific workshop containing 32 academics at an international conference. It captures ecologically valid social interactions in a weakly scripted setting consisting of two 30-minute mingling sessions with real professional and social consequences for the participants involved. We argue that future intelligent systems could be better equipped to handle subjective perceptions by modeling their multiplicity not as label noise but as a explainable perspective-driven reasoning process. We focus on the Apparent Intent Inference (AII) problem as determined by ex-situ observers and conceptualize intentions to be independent of manifest future outcomes. We contribute 1. a novel annotation process for AII that accounts for a perceiver's own interpretative tendencies, 2. quantitative and qualitative analyses of intent narratives with respect to diversity, grounding, and plausibility; 3. benchmark tasks for AII and surrounding relevant contextual factors such as social involvement; 4. speech quality audio for all participants as well as privacy preserving multi-modal data, enabling lexical and nonverbal behavior analysis; and 5. coupling of self-reported goals of each participant (30 minute to 3 hour) with annotated AII (seconds).