NarraScore: 通过分层情感控制弥合视觉叙事与音乐动态
NarraScore: Bridging Visual Narrative and Musical Dynamics via Hierarchical Affective Control
AI总结:
NarraScore通过分层情感控制,实现视觉叙事与音乐动态的融合,以高密度压缩叙事逻辑,提升长视频配乐生成的连贯性与自主性。
摘要:
合成长视频连贯的配乐仍是一个严峻挑战,目前受到三个关键障碍的阻碍:计算可扩展性、时间一致性以及最关键的是对不断演变的叙事逻辑的语义盲区。为弥合这些差距,我们提出了NarraScore,一个基于核心洞察的分层框架,即情感是叙事逻辑的高密度压缩。独特的是,我们将冻结的视觉-语言模型(VLMs)重新用作连续情感传感器,将高维视觉流压缩成密集的叙事感知的效价-唤醒轨迹。机制上,NarraScore采用双分支注入策略来调和全局结构与局部动态:一个全局语义锚点确保风格稳定性,而一个手术级的token级情感适配器通过直接元素级残差注入调节局部张力。这种极简设计绕过了密集注意力和架构克隆的瓶颈,有效缓解了数据稀缺带来的过拟合风险。实验表明,NarraScore在计算开销极低的情况下实现了最先进的连贯性和叙事一致性,建立了长视频配乐生成的完全自主范式。
英文摘要:
Synthesizing coherent soundtracks for long-form videos remains a formidable challenge, currently stalled by three critical impediments: computational scalability, temporal coherence, and, most critically, a pervasive semantic blindness to evolving narrative logic. To bridge these gaps, we propose NarraScore, a hierarchical framework predicated on the core insight that emotion serves as a high-density compression of narrative logic. Uniquely, we repurpose frozen Vision-Language Models (VLMs) as continuous affective sensors, distilling high-dimensional visual streams into dense, narrative-aware Valence-Arousal trajectories. Mechanistically, NarraScore employs a Dual-Branch Injection strategy to reconcile global structure with local dynamism: a \textit{Global Semantic Anchor} ensures stylistic stability, while a surgical \textit{Token-Level Affective Adapter} modulates local tension via direct element-wise residual injection. This minimalist design bypasses the bottlenecks of dense attention and architectural cloning, effectively mitigating the overfitting risks associated with data scarcity. Experiments demonstrate that NarraScore achieves state-of-the-art consistency and narrative alignment with negligible computational overhead, establishing a fully autonomous paradigm for long-video soundtrack generation.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。