Global Cross-Modal Geo-Localization: A Million-Scale Dataset and a Physical Consistency Learning Framework
School of Remote Sensing and Information Engineering, Wuhan University(武汉大学遥感与信息工程学院);First Surveying and Mapping Institute of Hunan Province(湖南省第一测绘院)
Cross-modal Geo-localization (CMGL) matches ground-level text descriptions with geo-tagged aerial imagery, which is crucial for pedestrian navigation and emergency response. However, existing studies are constrained by narrow geographic coverage and simplistic scene diversity, failing to reflect the immense spatial heterogeneity of global architectural styles and topographic features. To bridge this gap and facilitate universal positioning, we introduce CORE, the first million-scale dataset dedicated to global CMGL. CORE comprises 1,034,786 cross-view images sampled from 225 distinct geographic regions across six continents, offering an unprecedented variety of perspectives in varying environmental conditions and urban layouts. We leverage the zero-shot reasoning of Large Vision-Language Models (LVLMs) to synthesize high-quality scene descriptions rich in discriminative cues. Furthermore, we propose a physical-law-aware network (PLANET) for cross-modal geo-localization. PLANET introduces a novel contrastive learning paradigm to guide textual representations in capturing the intrinsic physical signatures of satellite imagery. Extensive experiments across varied geographic regions demonstrate that PLANET significantly outperforms state-of-the-art methods, establishing a new benchmark for robust, global-scale geo-localization. The dataset and source code will be released at https://github.com/YtH0823/CORE.
Recipe1M+: A Dataset for Learning Cross-Modal Embeddings for Cooking Recipes and Food Images
Massachusetts Institute of Technology(麻省理工学院);Qatar Computing Research Institute, HBKU(哈马德·本·哈利法大学卡塔尔计算研究所);Universitat Politècnica de Catalunya(加泰罗尼亚理工大学)
Unifying Biomedical Vision-Language Expertise: Towards a Generalist Foundation Model via Multi-CLIP Knowledge Distillation
Department of Radiation Oncology, Winship Cancer Institute, Emory University School of Medicine(放射肿瘤科,Winship癌症研究所,埃默里大学医学院);Department of Biomedical Engineering, College of Engineering, Georgia Institute of Technology(生物医学工程系,工程学院,佐治亚理工学院);Department of Computer Science and Mathematics, Laney Graduate School, Emory University(计算机科学与数学系,兰尼研究生院,埃默里大学);School of Electrical and Computer Engineering, College of Engineering, Georgia Institute of Technology(电气与计算机工程系,工程学院,佐治亚理工学院)
LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairs
LAION;Gentec Data;Technical University of Munich(慕尼黑工业大学);Juelich Supercomputing Center (JSC)(于利希超级计算中心);Research Center Juelich (FZJ)(于利希研究中心);Georgia Institute of Technology(佐治亚理工学院);EleutherAI
Can a Second-View Image Be a Language? Geometric and Semantic Cross-Modal Reasoning for X-ray Prohibited Item Detection
Institute of Information Science, Beijing Jiaotong University(北京交通大学信息科学学院);State Key Laboratory of Complex & Critical Software Environment, Beihang University(北航复杂与关键软件环境国家重点实验室)
GeoMeld: Toward Semantically Grounded Foundation Models for Remote Sensing
Indian Institute of Technology Bombay(印度理工学院孟买分校);Space Applications Centre, ISRO(印度空间研究组织空间应用中心);University of Trento(特伦托大学);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学)
Hausa Visual Genome: A Dataset for Multi-Modal English to Hausa Machine Translation
Ahmadu Bello University(艾哈迈杜·贝罗大学);KIIT University(KIIT大学);Silo AI;INESC TEC;University of Porto(波尔图大学);Bayero University(巴耶罗大学);City University of New York(纽约城市大学);Charles University(查理大学)
BEAT: A Large-Scale Semantic and Emotional Multi-Modal Dataset for Conversational Gestures Synthesis
The University of Tokyo(东京大学);Keio University(庆应义塾大学);Huawei Technologies Japan K.K.(华为技术日本株式会社);Japan Advanced Institute of Science and Technology(日本北陆先端科学技术大学院大学);Huawei Turkey R&D Center(华为土耳其研发中心)
GeoUniPR: A Geometry-Consistent Unified Framework for Cross-Modal Place Recognition
School of Computer Science and Technology, Tongji University(同济大学计算机科学与技术学院);Shanghai Research Institute for Intelligent Autonomous System, Tongji University(同济大学上海智能自主系统研究院);Shanghai Innovation Institute(上海创新研究院)
Moments in Time Dataset: one million videos for event understanding
Massachusetts Institute of Technology(麻省理工学院);International Business Machines(国际商业机器公司);The Chinese University of Hong Kong(香港中文大学);Columbia University(哥伦比亚大学);Boston University(波士顿大学)
我们展示了Moments in Time数据集,这是一个大规模的人工注释集合,包含100万个短视频,对应于三秒内展开的动态事件。即使对于3秒视频中发生的动作,对空间-音频-时间动态进行建模也提出了许多挑战:有意义的事件不仅包括人,还包括物体、动物和自然现象;视觉和听觉事件可以在时间上对称(“打开”是“关闭”),并且是短暂的或持续的。我们描述了我们的数据集的注释过程(每个视频都标记有339个不同类别中的一个动作或活动标签),与其他大规模视频数据集相比,分析其规模和多样性,以进行动作识别,并报告几个基线模型的结果,分别和联合,三种模式:空间,时间和听觉。Moments in Time数据集旨在在视觉和听觉模式中具有大范围和多样性的事件,可以作为开发模型的新挑战,这些模型可以扩展到人类日常处理的复杂性和抽象推理水平。
Libra: Building Decoupled Vision System on Large Language Models
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of the Chinese Academy of Sciences(中国科学院大学人工智能学院);Peng Cheng Laboratory(鹏城实验室)
Seeing 3D Through 2D Lenses: 3D Few-Shot Class-Incremental Learning via Cross-Modal Geometric Rectification
South China University of Technology(南方科技大学);State Key Laboratory of Subtropical Building Science(亚热带建筑科学国家重点实验室);Guangdong Provincial Key Lab of Computational Intelligence and Cyberspace Information(广东省计算智能与网络信息重点实验室);Ministry of Education Key Laboratory of Big Data and Intelligent Robot(教育部大数据与智能机器人重点实验室);Singapore Management University(新加坡国立大学)
SYNBUILD-3D: A large, multi-modal, and semantically rich synthetic dataset of 3D building models at Level of Detail 4
Department of Civil and Environmental Engineering, Stanford University(土木与环境工程系,斯坦福大学);Department of Computer Science, Stanford University(计算机科学系,斯坦福大学)
OCTCube-M: A 3D multimodal optical coherence tomography foundation model for retinal and systemic diseases with cross-cohort and cross-device validation