更长的时间上下文如何增强大脑对多模态叙事视频的处理？
How does longer temporal context enhance multimodal narrative video processing in the brain?
AI总结：
本研究探讨了视频片段时长和叙事任务提示如何影响自然电影观看过程中大脑模型对多模态大语言模型（MLLMs）的对齐情况，发现增加片段持续时间显著提高了大脑对齐程度，而单模态视频模型则无明显提升。
摘要：
理解人类和人工智能系统如何处理复杂的叙事视频是一个在神经科学和机器学习交汇处的基本挑战。本研究调查了视频片段的时间上下文长度（3-24秒片段）和叙事任务提示如何影响自然电影观看过程中大脑模型的对齐情况。利用受试者观看完整电影的fMRI记录，我们研究了对叙事上下文敏感的大脑区域如何在不同时间尺度上动态表示信息，以及这些神经模式如何与模型派生的特征对齐。我们发现，增加片段持续时间显著提高了多模态大语言模型（MLLMs）的大脑对齐程度，而单模态视频模型则几乎没有提升。进一步地，较短的时间窗口与感知和早期语言区域对齐，而较长的窗口则更倾向于与更高阶整合区域对齐，这在MLLMs中表现为层到皮层的层次结构。最后，使用四个叙事任务提示的实验显示，这些提示会引发任务特定、区域依赖性的大脑对齐模式，并在更高阶区域引起上下文依赖的片段级调谐变化。我们的工作将长篇叙事电影定位为研究长时间尺度时间整合在长上下文MLLMs中的原理性测试平台，以及其与叙事理解过程中皮层响应关系的桥梁。
英文摘要：
Understanding how humans and artificial intelligence systems process complex narrative videos is a fundamental challenge at the intersection of neuroscience and machine learning. This study investigates how the temporal context length of video clips (3--24 s clips) and the narrative-task prompting shape brain-model alignment during naturalistic movie watching. Using fMRI recordings from participants viewing full-length movies, we examine how brain regions sensitive to narrative context dynamically represent information over varying timescales and how these neural patterns align with model-derived features. We find that increasing clip duration substantially improves brain alignment for multimodal large language models (MLLMs), whereas unimodal video models show little to no gain. Further, shorter temporal windows align with perceptual and early language regions, while longer windows preferentially align higher-order integrative regions, mirrored by a layer-to-cortex hierarchy in MLLMs. Finally, experiments with four narrative-task prompts show that they elicit task-specific, region-dependent brain alignment patterns and context-dependent shifts in clip-level tuning in higher-order regions. Our work positions long-form narrative movies as a principled testbed for studying long-timescale temporal integration in long-context MLLMs and its relationship to cortical responses during narrative comprehension.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
