多模态大模型

Multimodal Foundation Model-Driven User Interest Modeling and Behavior Analysis on Short Video Platforms

Yushang Zhao, Yike Peng, Li Zhang, Qianyi Sun, Zhihui Zhang, Yingying Zhuang

专题命中 视频多模态 ：multimodal(title,abstract)；multimodal foundation model(title,abstract)；cross-modal(abstract)

MMoE: Robust Spoiler Detection with Multi-modal Information and Domain-aware Mixture-of-Experts

Zinan Zeng, Sen Ye, Zijian Cai, Heng Wang, Yuhan Liu, Haokai Zhang, Minnan Luo

机构 * Xi’an Jiaotong University（西安交通大学） 纠错

专题命中 视频多模态 ：multi-modal(title,abstract)；分类 cs.AI

ThumbnailTruth: A Multi-Modal LLM Approach for Detecting Misleading YouTube Thumbnails Across Diverse Cultural Settings

Wajiha Naveed, Zartash Afzal Uzmi, Zafar Ayyub Qazi

专题命中 视频多模态 ：multi-modal(title,abstract)

Efficient Video-to-Audio Generation via Multiple Foundation Models Mapper

Gehui Chen, Guan'an Wang, Xiaowen Huang, Jitao Sang

机构 * School of Computer Science ； Technology, Beijing Jiaotong University Beijing China ； Beijing Key Laboratory of Traffic Data Mining ； Key Laboratory of Big Data \& Artificial Intelligence in Transportation, Ministry of Education Beijing China ； Technology, Beijing Jiaotong University ； Key Laboratory of Big Data \& Artificial Intelligence in Transportation, Ministry of Education 纠错

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.CV、cs.MM、eess.AS

TPA: Temporal Prompt Alignment for Fetal Congenital Heart Defect Classification

Darya Taratynova, Alya Almsouti, Beknur Kalmakhanbet, Numan Saeed, Mohammad Yaqub

机构 * Department of Machine Learning Mohamed bin Zayed University of Artificial Intelligence (MBZUAI) Abu Dhabi, UAE（机器学习系，Mohamed bin Zayed人工智能大学（MBZUAI），阿布扎比，阿联酋） ； Department of Computer Vision Mohamed bin Zayed University of Artificial Intelligence (MBZUAI) Abu Dhabi, UAE（计算机视觉系，Mohamed bin Zayed人工智能大学（MBZUAI），阿布扎比，阿联酋） 纠错

专题命中 视频多模态 ：image-text(abstract)；分类 cs.CV

Evaluating Temporal Patterns in Applied Infant Affect Recognition

Allen Chang, Lauren Klein, Marcelo R. Rosales, Weiyang Deng, Beth A. Smith, Maja J. Matarić

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.AI

Comments 8 pages, 6 figures, 10th International Conference on Affective Computing and Intelligent Interaction (ACII 2022)

Large Language Models with Temporal Reasoning for Longitudinal Clinical Summarization and Prediction

Maya Kruse, Shiyue Hu, Nicholas Derby, Yifu Wu, Samantha Stonbraker, Bingsheng Yao, Dakuo Wang, Elizabeth Goldberg, Yanjun Gao

机构 * University of Colorado Anschutz Medical Campus（科罗拉多大学安舒茨医学校园） ； University of Colorado Boulder（科罗拉多大学波德分校） ； Northeastern University（东北大学） 纠错

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CL