arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2501.16100cs.CVcs.AIcs.LG
收藏

基于音频和视频源的体育精彩片段自动检测

Automated Detection of Sport Highlights from Audio and Video Sources

Politecnico di Torino(都灵理工大学);Gruppo Nazionale per il Calcolo Scientifico INdAM(意大利国家高等数学研究所国家科学计算小组);Deltatre S.p.A.(德尔塔特雷公司)

Francesco Della Santa, Morgana Lalli

AI总结:

本研究提出一种基于深度学习的轻量级方法,通过音频Mel频谱图和灰度视频帧小数据集训练模型,实现89%和83%的检测准确率,并利用多模态集成提升鲁棒性,为体育精彩片段自动检测提供可扩展且低成本的解决方案。

摘要:

本研究提出了一种新颖的基于深度学习的轻量级方法,用于从音频和视频源中自动检测体育精彩片段(HLs)。HL检测是体育视频分析中的一项关键任务,传统上需要大量人力。我们的解决方案利用在相对较小的音频Mel频谱图和灰度视频帧数据集上训练的深度学习(DL)模型,分别实现了89%和83%的音频和视频检测准确率。小数据集与简单架构的结合,证明了我们方法在快速且高性价比部署方面的实用性。此外,结合两种模态的集成模型显示出对假阳性和假阴性更强的鲁棒性。所提出的方法为跨多种体育视频内容的自动HL检测提供了可扩展的解决方案,减少了人工干预的需求。未来的工作将集中于增强模型架构,并将该方法扩展到媒体分析中更广泛的场景检测任务。

英文摘要:

This study presents a novel Deep Learning-based and lightweight approach for the automated detection of sports highlights (HLs) from audio and video sources. HL detection is a key task in sports video analysis, traditionally requiring significant human effort. Our solution leverages Deep Learning (DL) models trained on relatively small datasets of audio Mel-spectrograms and grayscale video frames, achieving promising accuracy rates of 89% and 83% for audio and video detection, respectively. The use of small datasets, combined with simple architectures, demonstrates the practicality of our method for fast and cost-effective deployment. Furthermore, an ensemble model combining both modalities shows improved robustness against false positives and false negatives. The proposed methodology offers a scalable solution for automated HL detection across various types of sports video content, reducing the need for manual intervention. Future work will focus on enhancing model architectures and extending this approach to broader scene-detection tasks in media analysis.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑