首页/论文/2012.15641

arXiv 2012.156412020-12-31cs.MMcs.AIcs.CV

Investigating Memorability of Dynamic Media

Dublin City University（都柏林城市大学）

Phuc H. Le-Khac, Ayush K. Rai, Graham Healy, Alan F. Smeaton, Noel E. O'Connor

备注：: 3 pages, 1 figure. 1 table
发表信息：: MediaEval Multimedia Benchmark Workshop Working Notes, 14-15 December 2020

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

英文摘要相关论文

英文摘要：

The Predicting Media Memorability task in MediaEval'20 has some challenging aspects compared to previous years. In this paper we identify the high-dynamic content in videos and dataset of limited size as the core challenges for the task, we propose directions to overcome some of these challenges and we present our initial result in these directions.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

Overview of The MediaEval 2021 Predicting Media Memorability Task

University of Essex（埃塞克斯大学）；University Politehnica of Bucharest（布加勒斯特理工大学）；InterDigital（InterDigital公司）；Dublin City University（都柏林城市大学）；Massachusetts Institute of Technology（麻省理工学院）

This paper describes the MediaEval 2021 Predicting Media Memorability}task, which is in its 4th edition this year, as the prediction of short-term and long-term video memorability remains a challenging task. In 2021, two datasets of videos are used: first, a subset of the TRECVid 2019 Video-to-Text dataset; second, the Memento10K dataset in order to provide opportunities to explore cross-dataset generalisation. In addition, an Electroencephalography (EEG)-based prediction pilot subtask is introduced. In this paper, we outline the main aspects of the task and describe the datasets, evaluation m…

2021-12-11cs.AIcs.CVcs.MM

Overview of The MediaEval 2022 Predicting Video Memorability Task

Dublin City University（都柏林城市大学）；University Politehnica of Bucharest（布加勒斯特理工大学）；Massachusetts Institute of Technology（麻省理工学院）；University of Essex（埃塞克斯大学）

This paper describes the 5th edition of the Predicting Video Memorability Task as part of MediaEval2022. This year we have reorganised and simplified the task in order to lubricate a greater depth of inquiry. Similar to last year, two datasets are provided in order to facilitate generalisation, however, this year we have replaced the TRECVid2019 Video-to-Text dataset with the VideoMem dataset in order to remedy underlying data quality issues, and to prioritise short-term memorability prediction by elevating the Memento10k dataset as the primary dataset. Additionally, a fully fledged electroenc…

2022-12-13cs.AIcs.CVcs.MM

MediaEval 2018: Predicting Media Memorability Task

Technicolor（特艺集团）；Aalto University（阿尔托大学）；University Politehnica of Bucharest（布加勒斯特理工大学）；University of Adelaide（阿德莱德大学）

In this paper, we present the Predicting Media Memorability task, which is proposed as part of the MediaEval 2018 Benchmarking Initiative for Multimedia Evaluation. Participants are expected to design systems that automatically predict memorability scores for videos, which reflect the probability of a video being remembered. In contrast to previous work in image memorability prediction, where memorability was measured a few minutes after memorization, the proposed dataset comes with short-term and long-term memorability annotations. All task characteristics are described, namely: the task's ch…

2018-07-03cs.CV

Multi-modal Ensemble Models for Predicting Video Memorability

University of California, Berkeley（加州大学伯克利分校）

Modeling media memorability has been a consistent challenge in the field of machine learning. The Predicting Media Memorability task in MediaEval2020 is the latest benchmark among similar challenges addressing this topic. Building upon techniques developed in previous iterations of the challenge, we developed ensemble methods with the use of extracted video, image, text, and audio features. Critically, in this work we introduce and demonstrate the efficacy and high generalizability of extracted audio embeddings as a feature for the task of predicting media memorability.

2021-02-01cs.AIcs.LGcs.MM

An Annotated Video Dataset for Computing Video Memorability

University of Essex（埃塞克斯大学）；Insight Centre for Data Analytics, Dublin City University（都柏林城市大学洞察数据分析中心）；University Politehnica of Bucharest（布加勒斯特理工大学）；InterDigital, R&I（InterDigital 研究与创新部）

Using a collection of publicly available links to short form video clips of an average of 6 seconds duration each, 1,275 users manually annotated each video multiple times to indicate both long-term and short-term memorability of the videos. The annotations were gathered as part of an online memory game and measured a participant's ability to recall having seen the video previously when shown a collection of videos. The recognition tasks were performed on videos seen within the previous few minutes for short-term memorability and within the previous 24 to 72 hours for long-term memorability. D…

2021-12-04cs.AIcs.CV

Leveraging Audio Gestalt to Predict Media Memorability

Insight Centre for Data Analytics（洞察数据分析中心）；Dublin City University（都柏林城市大学）

Memorability determines what evanesces into emptiness, and what worms its way into the deepest furrows of our minds. It is the key to curating more meaningful media content as we wade through daily digital torrents. The Predicting Media Memorability task in MediaEval 2020 aims to address the question of media memorability by setting the task of automatically predicting video memorability. Our approach is a multimodal deep learning-based late fusion that combines visual, semantic, and auditory features. We used audio gestalt to estimate the influence of the audio modality on overall video memor…

2020-12-31cs.AIcs.CVcs.MM

更多相关论文收起更多论文

Overview of MediaEval 2020 Predicting Media Memorability Task: What Makes a Video Memorable?

University of Essex（埃塞克斯大学）；University Politehnica of Bucharest（布加勒斯特理工大学）；InterDigital（InterDigital公司）；Dublin City University（都柏林城市大学）

This paper describes the MediaEval 2020 \textit{Predicting Media Memorability} task. After first being proposed at MediaEval 2018, the Predicting Media Memorability task is in its 3rd edition this year, as the prediction of short-term and long-term video memorability (VM) remains a challenging task. In 2020, the format remained the same as in previous editions. This year the videos are a subset of the TRECVid 2019 Video-to-Text dataset, containing more action rich video content as compared with the 2019 task. In this paper a description of some aspects of this task is provided, including its m…

2020-12-31cs.AIcs.CVcs.MM

基于LLM的多模态特征融合用于商业广告记忆度预测

LLM-based Fusion of Multi-modal Features for Commercial Memorability Prediction

Georgia Institute of Technology, USA（佐治亚理工学院）

本文提出基于Gemma-3 LLM的多模态融合系统，结合ViT和E5特征及LLM生成的理由提示，在MediaEval 2025商业记忆度预测任务中优于梯度提升树基线，展现出更强的鲁棒性和泛化能力。

2025-10-26cs.AIcs.CVcs.MM

Investigating African-American Vernacular English in Transformer-Based Text Generation

University of California, Santa Barbara（加州大学圣巴巴拉分校）

The growth of social media has encouraged the written use of African American Vernacular English (AAVE), which has traditionally been used only in oral contexts. However, NLP models have historically been developed using dominant English varieties, such as Standard American English (SAE), due to text corpora availability. We investigate the performance of GPT-2 on AAVE text by creating a dataset of intent-equivalent parallel AAVE/SAE tweet pairs, thereby isolating syntactic structure and AAVE- or SAE-specific language for each pair. We evaluate each sample and its GPT-2 generated text with pre…

2020-10-29cs.AIcs.CL