arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2604.20311cs.MMcs.AI
收藏

看得更远且更广:面向微视频流行度预测的联合时空放大

Seeing Further and Wider: Joint Spatio-Temporal Enlargement for Micro-Video Popularity Prediction

Huazhong University of Science and Technology(华中科技大学);La Trobe University(拉特罗布大学);Beijing Institute of Computer Technology and Applications(北京计算机技术与应用研究所)

Dali Wang, Yunyao Zhang, Junqing Yu, Yi-Ping Phoebe Chen, Chen Xu, Zikai Song

AI总结:

本文提出联合时空放大框架,通过时空增强模块提升微视频流行度预测的精度与可扩展性,实验表明其在主流指标上优于11个基线方法。

摘要:

微视频流行度预测(MVPP)旨在预测在线媒体上视频的未来流行度,对内容推荐和流量分配等应用至关重要。在现实场景中,MVPP方法必须理解给定视频的时间动态(时间)及其与其他视频的历史相关性(空间)。然而,现有方法在两个维度上都存在局限:时间上依赖稀疏短程采样,限制了内容感知;空间上依赖平坦的检索内存,容量有限且效率低,阻碍了可扩展的知识利用。为克服这些限制,我们提出一个统一的框架,实现联合时空放大,能够精确感知极长的视频序列,同时支持可扩展的内存银行,可无限扩展以纳入所有相关的历史视频。技术上,我们采用由帧评分模块驱动的时间放大,通过两种互补路径从视频帧中提取亮点线索:稀疏采样和密集感知。它们的输出被自适应融合,以实现稳健的长序列内容理解。对于空间放大,我们构建了一个拓扑感知内存银行,基于拓扑关系对历史相关的内容进行层次聚类。与其直接扩展内存容量不同,我们通过纳入新视频时更新相应聚类的编码特征,从而实现无界的歷史关联,而无需无界的存储增长。在三个广泛使用的MVPP基准测试中,大量实验表明,我们的方法在主流指标上一致优于11个强大的基线方法,实现了预测准确性和排名一致性方面的稳健改进。

英文摘要:

Micro-video popularity prediction (MVPP) aims to forecast the future popularity of videos on online media, which is essential for applications such as content recommendation and traffic allocation. In real-world scenarios, it is critical for MVPP approaches to understand both the temporal dynamics of a given video (temporal) and its historical relevance to other videos (spatial). However, existing approaches sufer from limitations in both dimensions: temporally, they rely on sparse short-range sampling that restricts content perception; spatially, they depend on flat retrieval memory with limited capacity and low efficiency, hindering scalable knowledge utilization. To overcome these limitations, we propose a unified framework that achieves joint spatio-temporal enlargement, enabling precise perception of extremely long video sequences while supporting a scalable memory bank that can infinitely expand to incorporate all relevant historical videos. Technically, we employ a Temporal Enlargement driven by a frame scoring module that extracts highlight cues from video frames through two complementary pathways: sparse sampling and dense perception. Their outputs are adaptively fused to enable robust long-sequence content understanding. For Spatial Enlargement, we construct a Topology-Aware Memory Bank that hierarchically clusters historically relevant content based on topological relationships. Instead of directly expanding memory capacity, we update the encoder features of the corresponding clusters when incorporating new videos, enabling unbounded historical association without unbounded storage growth. Extensive experiments on three widely used MVPP benchmarks demonstrate that our method consistently outperforms 11 strong baselines across mainstream metrics, achieving robust improvements in both prediction accuracy and ranking consistency.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑