We propose a cross-media lecture-on-demand system, in which users can selectively view specific segments of lecture videos by submitting text queries. Users can easily formulate queries by using the textbook associated with a target lecture, even if they cannot come up with effective keywords. Our system extracts the audio track from a target lecture video, generates a transcription by large vocabulary continuous speech recognition, and produces a text index. Experimental results showed that by adapting speech recognition to the topic of the lecture, the recognition accuracy increased and the retrieval accuracy was comparable with that obtained by human transcription.
Prospective Study for Semantic Inter-Media Fusion in Content-Based Medical Image Retrieval
University of Besançon（贝桑松大学）；IPAL-Image Perception, Access and Language, UMI CNRS 2955, NUS, UJF, I2R - A*STAR, Singapore（新加坡国立大学、法国国家科研中心、约瑟夫·傅里叶大学、新加坡资讯通信研究院、新加坡科技研究局联合成立的IPAL机构）；Faculty of Sciences, University of Besançon（贝桑松大学理学院）；School of Computing, National University of Singapore（新加坡国立大学计算机学院）
GORAG: Graph-based Online Retrieval Augmented Generation for Dynamic Few-shot Social Media Text Classification
The Hong Kong University of Science and Technology（香港科学与技术大学）；The Hong Kong Polytechnic University（香港理工大学）；Guangzhou HKUST Fok Ying Tung Research Institute（广州HKUST福ying顿研究 institute）
ViSeRet: A simple yet effective approach to moment retrieval via fine-grained video segmentation
Twelve Labs；KAIST（韩国科学技术院）
视频文本检索有许多现实世界的应用，如媒体分析，监控和机器人。本文介绍了ICCV Value Challenge 2021视频检索赛道的第一名解决方案。我们提出了一个简单而有效的方法来联合处理两个视频文本检索任务（视频检索和视频语料库矩检索），利用模型只训练视频检索任务。此外，我们还创建了一个集成模型，在Value Challenge中提出的所有四个数据集（TVr，How2r，YouCook2r和VATEXr）上实现了最先进的性能。
Deep Multimodal Image-Text Embeddings for Automatic Cross-Media Retrieval
Institute for Advanced Studies in Basic Sciences (IASBS)（基础科学高级研究所）；Charles University（查尔斯大学）；Institute for Research in Fundamental Sciences (IPM)（基础科学研究所）；University of Parma（帕尔马大学）
Streamlining Social Media Information Retrieval for COVID-19 Research with Deep Learning
Harvard Chan School of Public Health（哈佛陈曾熙公共卫生学院）；Harvard Medical School（哈佛医学院）；Brigham and Women’s Hospital（布列根和妇女医院）；Zhejiang University School of Medicine（浙江大学医学院）；The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州））
