基于语义增强的时态图网络的内容流行度预测
Semantics-enhanced Temporal Graph Networks for Content Popularity Prediction
摘要:
对高清视频流服务和大型神经网络模型(例如,生成式预训练Transformer,GPT)意味着互联网流量的巨大爆炸。为了减轻流量压力,已经提出了具有网络内存储的架构,以在更接近用户的设备处缓存流行内容。相应地,为了最大化缓存利用率,设计有效的流行度预测方法变得至关重要。在这方面,预测流行度与动态图神经网络(DGNN)模型取得了显着的性能。然而,DGNN模型仍然难以处理大多数用户不活跃的稀疏数据集。因此,我们提出了一种改进的时间图网络,命名为语义增强的时间图网络(STGN),它附加额外的语义信息到用户内容二分图,可以更好地利用隐含的关系背后的表面拓扑结构。最重要的是,我们定制了它的时间和结构学习模块,以进一步提高预测性能。具体来说,为了有效地聚合内容可能拥有的多样化语义,我们设计了一个特定于用户的注意(UsAttn)机制的时间学习模块。与只分析体裁对内容的影响的注意力机制不同,UsAttn还考虑了语义信息对特定用户的吸引力。同时,在结构化学习方面,我们将位置编码的概念引入到基于注意力的图学习中,并采用语义位置编码(SPE)函数来促进面向内容的用户关联分析。最后,大量的模拟验证了我们的STGN模型的优越性,并证明了在内容缓存的有效性。
英文摘要:
The surging demand for high-definition video streaming services and large neural network models (e.g., Generative Pre-trained Transformer, GPT) implies a tremendous explosion of Internet traffic. To mitigate the traffic pressure, architectures with in-network storage have been proposed to cache popular contents at devices in closer proximity to users. Correspondingly, in order to maximize caching utilization, it becomes essential to devise an effective popularity prediction method. In that regard, predicting popularity with dynamic graph neural network (DGNN) models achieve remarkable performance. However, DGNN models still suffer from tackling sparse datasets where most users are inactive. Therefore, we propose a reformative temporal graph network, named semantics-enhanced temporal graph network (STGN), which attaches extra semantic information into the user-content bipartite graph and could better leverage implicit relationships behind the superficial topology structure. On top of that, we customize its temporal and structural learning modules to further boost the prediction performance. Specifically, in order to efficiently aggregate the diversified semantics that a content might possess, we design a user-specific attention (UsAttn) mechanism for temporal learning module. Unlike the attention mechanism that only analyzes the influence of genres on content, UsAttn also considers the attraction of semantic information to a specific user. Meanwhile, as for the structural learning, we introduce the concept of positional encoding into our attention-based graph learning and adopt a semantic positional encoding (SPE) function to facilitate the analysis of content-oriented user-association analysis. Finally, extensive simulations verify the superiority of our STGN models and demonstrate the effectiveness in content caching.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。