多模态大模型

ProM3E: Probabilistic Masked MultiModal Embedding Model for Ecology

Srikumar Sastry, Subash Khanal, Aayush Dhakal, Jiayu Lin, Dan Cher, Phoenix Jarosz, Nathan Jacobs

机构 * Washington University in St. Louis（华盛顿大学圣路易斯分校） 纠错

专题命中 跨模态检索 ：multimodal(title,abstract)；cross-modal(abstract)；any-to-any(abstract)；分类 cs.CV

Comments 21 pages, 16 figures

SCALE-VLP: Soft-Weighted Contrastive Volumetric Vision-Language Pre-training with Spatial-Knowledge Semantics

Ailar Mahdizadeh, Puria Azadi Moghadam, Xiangteng He, Shahriar Mirabbasi, Panos Nasiopoulos, Leonid Sigal

机构 * University of British Columbia（不列颠哥伦比亚大学） ； Vector Institute for AI（人工智能向量研究所） 纠错

专题命中 跨模态检索 ：cross-modal(abstract)；分类 cs.CV