在虚拟现实中解读眼神：社会智能的多模态建模
Reading the Eyes in VR: Multimodal Modeling of Social Intelligence
浏览论文内容
中文总结 AI 辅助
研究通过在 Unity 中为桌面和 VR 实现 RMET 并进行 2x2 混合研究，探究呈现媒介和反馈对 RMET 行为的影响。结果表明即时反馈影响注视和脑电，呈现媒介无客观差异，VR 可用性高，为 RMET 在受控环境作过程感知评估任务提供证据。
中文摘要 AI 辅助
社会智能是指解读他人情绪、信念和意图的能力，通常通过“解读眼神中的心思测试”（RMET）来评估，参与者需从眼部区域图像推断心理状态。然而，RMET 通常在纸质或桌面显示器上呈现，观看几何形状因人而异，且很少有即时反馈。我们研究了呈现媒介和简短试验级反馈是否会影响 RMET 行为。我们在 Unity 中为桌面和虚拟现实（VR）实现了 RMET，利用 VR 在不改变项目的情况下保持刺激距离和视野恒定。我们对 20 名参与者进行了 2x2 混合研究，在受试者之间操纵设备（VR 与桌面），在受试者内部操纵反馈（即时正确性提示与无）。记录眼动追踪和脑电图数据，并与行为日志同步。我们分析了基于注视的注视测量、脑电图信号、反应时间、准确性和主观测量。即时反馈与更长的注视持续时间和更高的基于脑电图的参与度相关，而在任务完成时间或总正确答案方面未观察到显著差异。呈现媒介在客观测量中未产生可靠差异，但 VR 的可用性评分更高，也被评为更费力。这些结果提供了初步证据，表明 RMET 可以在受控的 VR 和桌面设置中作为一种过程感知评估任务进行研究。
英文摘要
Social intelligence, the ability to interpret others' emotions, beliefs, and intentions, is often assessed with the Reading the Mind in the Eyes Test (RMET), in which participants infer mental states from images of the eye region. Yet RMET is typically presented on paper or desktop displays, where viewing geometry can vary across participants, and it rarely includes immediate feedback. We investigated whether presentation medium and brief trial-level feedback influence RMET behavior. We implemented RMET in Unity for both desktop and Virtual Reality (VR), using VR to hold stimulus distance and field of view constant without changing the items. We conducted a 2x2 mixed study with 20 participants, with device (VR vs. desktop) manipulated between subjects and feedback (immediate correctness cue vs. none) manipulated within subjects. Eye-tracking and EEG data were recorded and synchronized with behavioral logs. We analyzed fixation-based gaze measures, EEG signals, response time, accuracy, and subjective measures. Immediate feedback was associated with longer fixation durations and higher EEG-based engagement, while no significant differences were observed in task completion time or total correct answers. Presentation medium did not produce reliable differences in the objective measures, but VR received higher usability ratings and was also rated as more effortful. These results provide initial evidence that RMET can be studied as a process-aware assessment task in controlled VR and desktop settings.
发表机构
- University of Delaware（特拉华大学）
机构由 AI 辅助整理，请以论文原文为准。
