High-quality and diverse multimodal data are essential for improving vision-language models (VLMs), yet existing datasets often contain noisy, redundant, and poorly aligned samples. To address these problems, data filtering is commonly used to enhance the efficiency and performance of multimodal learning, but it introduces extra computational cost because filtering models are usually trained on the same data they are meant to screen. To reduce this cost, we study DOSE, which explores whether off-the-shelf pretrained models that have never seen the target data can be used to select training samples for larger and stronger multimodal models without any task-specific training. Even without fine-tuning, these models can effectively assess text quality and image-text alignment to guide data selection. Based on this, we build a joint quality-alignment distribution and apply adaptive weighted sampling to select informative samples while maintaining long-tail diversity. This approach enhances data diversity, enabling models trained on DOSE-filtered data to match or surpass those trained on the full dataset on standard VQA and math benchmarks. Extensive experiments demonstrate its effectiveness, efficiency, and scalability.
ASAP: Advancing Semantic Alignment Promotes Multi-Modal Manipulation Detecting and Grounding
School of Computer Science and Information Engineering, Hefei University of Technology, China(计算机科学与信息工程学院,合肥工业大学,中国);Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, China(人工智能研究所,合肥综合性国家科学中心,中国)
Supervise-assisted Multi-modality Fusion Diffusion Model for PET Restoration
Beijing Institute of Technology(北京理工大学);Research and Development Center of Agricultural Bank of China(中国农业银行研发中心);Peking University(北京大学);Beijing Normal University(北京师范大学)
REACT-KD: Region-Aware Cross-modal Topological Knowledge Distillation for Interpretable Medical Image Classification
Department of Health Technology and Informatics, Hong Kong Polytechnic University(健康科技与信息技术系,香港理工大学);Department of Nuclear Medicine and PET, Hong Kong Sanatorium and Hospital(核医学与PET部门,香港疗养院及医院)
MCAD: Multi-modal Conditioned Adversarial Diffusion Model for High-Quality PET Image Reconstruction
School of Computer Science, Sichuan University(四川大学计算机学院);The Hong Kong Polytechnic University(香港理工大学);School of Computer Science, Chengdu University of Information Technology(成都信息工程大学计算机学院)
Reliability of PET/CT shape and heterogeneity features in functional and morphological components of Non-Small Cell Lung Cancer tumors: a repeatability analysis in a prospective multi-center cohort
INSERM, UMR 1101, LaTIM, University of Brest, IBSAM(法国国家健康与医学研究院,UMR 1101,LaTIM,布雷斯特大学,IBSAM);Academic department of nuclear Medicine, CHU Milétrie(米莱特里大学医院核医学科);Memorial Sloan Kettering Cancer Center(纪念斯隆·凯特琳癌症中心);Mallinckrodt Institute of Radiology and the Siteman Cancer Center, Washington University School of Medicine(华盛顿大学医学院马林克罗特放射学研究所及Siteman癌症中心)
Depth AnyEvent: A Cross-Modal Distillation Paradigm for Event-Based Monocular Depth Estimation
Advanced Research Center on Electronic System (ARCES)(电子系统先进研究中心);Department of Computer Science and Engineering (DISI)(计算机科学与工程系);University of Bologna(博洛尼亚大学)
TARDis: Time Attenuated Representation Disentanglement for Incomplete Multi-Modal Tumor Segmentation and Classification
School of Automation and Electrical Engineering, University of Science and Technology Beijing(北京科技大学自动化与电气工程学院);Alibaba Group DAMO Academy(阿里巴巴集团DAMO学院);Hupan Lab(湖畔实验室);Departments of Radiology, Changhai Hospital(上海长海医院放射科)
Multi-Modal Fusion of In-Situ Video Data and Process Parameters for Online Forecasting of Cookie Drying Readiness
Department of Mechanical Science and Engineering, University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校机械科学与工程系);Department of Mechanical Engineering, University of Michigan(密歇根大学机械工程系)
Multi-Modal Zero-Shot Prediction of Color Trajectories in Food Drying
Department of Mechanical Science and Engineering, University of Illinois at Urbana-Champaign, Urbana, IL, USA(机械科学与工程系,伊利诺伊大学厄巴纳-香槟分校);Department of Mechanical Engineering, University of Michigan, Ann Arbor, MI, USA(机械工程系,密歇根大学安娜堡分校)
Multi-modal video data-pipelines for machine learning with minimal human supervision
Institute of Mathematics of the Romanian Academy "Simion Stoilow"(罗马尼亚科学院数学研究所 "Simion Stoilow");Faculty of Automatic Control and Computer Science, National University of Science and Technology POLITEHNICA(自动控制与计算机科学系,波兰技术大学)
Multi-granularity Contrastive Cross-modal Collaborative Generation for End-to-End Long-term Video Question Answering
School of Information Science and Technology, Hangzhou Normal University(杭州师范大学信息科学与技术学院);School of Computer Science and Technology, University of Chinese Academy of Sciences(中国科学院大学计算机科学与技术学院);School of Computer Science and Technology, Hangzhou Dianzi University(杭州电子科技大学计算机科学与技术学院);Department of Computer Science and Technology, Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳)计算机科学与技术系)
PMMTalk: Speech-Driven 3D Facial Animation from Complementary Pseudo Multi-modal Features
Macau University of Science and Technology(澳门科技大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学);University of Science and Technology Beijing(北京科技大学);Mashang Consumer Finance Co., Ltd(马上消费金融股份有限公司)