语言大模型 / LLM

CLASP: Contrastive Language-Speech Pretraining for Multilingual Multimodal Information Retrieval

Mohammad Mahdi Abootorabi, Ehsaneddin Asgari

专题命中 预训练与数据 ：pretraining(title,abstract)；分类 cs.CL

Comments accepted at ECIR 2025, 13 pages, 4 figures

E2ETune: End-to-End Knob Tuning via Fine-tuned Generative Language Model

Xinmei Huang, Haoyang Li, Jing Zhang, Xinxin Zhao, Zhiming Yao, Yiyan Li, Tieying Zhang, Jianjun Chen, Hong Chen, Cuiping Li

专题命中 预训练与数据 ：language model(title,abstract)；分类 cs.AI

Comments Accepted by VLDB 2025

HecVL: Hierarchical Video-Language Pretraining for Zero-shot Surgical Phase Recognition

Kun Yuan, Vinkle Srivastav, Nassir Navab, Nicolas Padoy

专题命中 预训练与数据 ：pretraining(title,abstract)；分类 cs.AI

Comments Accepted by MICCAI2024

Synthetic Data is an Elegant GIFT for Continual Vision-Language Models

Bin Wu, Wuxuan Shi, Jinqiao Wang, Mang Ye

专题命中 预训练与数据 ：language model(title,abstract)；分类 cs.LG

Comments This work is accepted by CVPR 2025. Modifications may be performed

TimeFound: A Foundation Model for Time Series Forecasting

Congxi Xiao, Jingbo Zhou, Yixiong Xiao, Xinjiang Lu, Le Zhang, Hui Xiong

专题命中 预训练与数据 ：foundation model(title,abstract)；分类 cs.LG

DELST: Dual Entailment Learning for Hyperbolic Image-Gene Pretraining in Spatial Transcriptomics

Xulin Chen, Junzhou Huang

专题命中 预训练与数据 ：pretraining(title,abstract)；分类 cs.AI

Unsupervised Parameter Efficient Source-free Post-pretraining

Abhishek Jha, Tinne Tuytelaars, Yuki M. Asano

专题命中 预训练与数据 ：pretraining(title,abstract)；分类 cs.LG

Pretraining Frequency Predicts Compositional Generalization of CLIP on Real-World Tasks

Thaddäus Wiedemer, Yash Sharma, Ameya Prabhu, Matthias Bethge, Wieland Brendel

专题命中 预训练与数据 ：pretraining(title,abstract)；分类 cs.LG

Comments NeurIPS 2024 Workshop on Compositional Learning: Perspectives, Methods, and Paths Forward

WavTokenizer: an Efficient Acoustic Discrete Codec Tokenizer for Audio Language Modeling

Shengpeng Ji, Ziyue Jiang, Wen Wang, Yifu Chen, Minghui Fang, Jialong Zuo, Qian Yang, Xize Cheng, Zehan Wang, Ruiqi Li, Ziang Zhang, Xiaoda Yang, Rongjie Huang, Yidi Jiang, Qian Chen, Siqi Zheng, Zhou Zhao

专题命中 预训练与数据 ：language model(title,abstract)；分类 cs.LG

Comments Accepted by ICLR 2025

Governing AI Beyond the Pretraining Frontier

Nicholas A. Caputo

专题命中 预训练与数据 ：pretraining(title,abstract)；分类 cs.AI

Comments 14 pages

Object-centric Binding in Contrastive Language-Image Pretraining

Rim Assouel, Pietro Astolfi, Florian Bordes, Michal Drozdzal, Adriana Romero-Soriano

专题命中 预训练与数据 ：pretraining(title)；language model(abstract)；分类 cs.AI

Reverse Question Answering: Can an LLM Write a Question so Hard (or Bad) that it Can't Answer?

Nishant Balepur, Feng Gu, Abhilasha Ravichander, Shi Feng, Jordan Boyd-Graber, Rachel Rudinger

专题命中 预训练与数据 ：LLM(title,abstract)；分类 cs.CL

Comments NAACL 2025

Making Language Models Robust Against Negation

MohammadHossein Rezaei, Eduardo Blanco

专题命中 预训练与数据 ：language model(title,abstract)；分类 cs.CL

Comments Accepted to NAACL 2025

Detecting Backdoor Samples in Contrastive Language Image Pretraining

Hanxun Huang, Sarah Erfani, Yige Li, Xingjun Ma, James Bailey

专题命中 预训练与数据 ：pretraining(title,abstract)；分类 cs.LG

Comments ICLR2025

Foundation Models in Radiology: What, How, When, Why and Why Not

Magdalini Paschali, Zhihong Chen, Louis Blankemeier, Maya Varma, Alaa Youssef, Christian Bluethgen, Curtis Langlotz, Sergios Gatidis, Akshay Chaudhari

专题命中 预训练与数据 ：foundation model(title,abstract)；分类 cs.LG

Comments This pre-print has been accepted for publication in Radiology. (DOI for the peer-reviewed article: 10.1148/radiol.240597)

Beyond Random Augmentations: Pretraining with Hard Views

Fabio Ferreira, Ivo Rapant, Jörg K. H. Franke, Frank Hutter

专题命中 预训练与数据 ：pretraining(title,abstract)；分类 cs.AI

Journal ref The Thirteenth International Conference on Learning Representations (ICLR) 2025

A generative foundation model for an all-in-one seismic processing framework

Shijun Cheng, Randy Harsuko, Tariq Alkhalifah

专题命中 预训练与数据 ：foundation model(title,abstract)；分类 cs.AI

How Does the Spatial Distribution of Pre-training Data Affect Geospatial Foundation Models?

Mirali Purohit, Gedeon Muhawenayo, Esther Rolf, Hannah Kerner

专题命中 预训练与数据 ：foundation model(title,abstract)；分类 cs.LG

Comments Accepted at Good Data for Generative AI @ AAAI 2025

UrbanVLP: Multi-Granularity Vision-Language Pretraining for Urban Socioeconomic Indicator Prediction

Xixuan Hao, Wei Chen, Yibo Yan, Siru Zhong, Kun Wang, Qingsong Wen, Yuxuan Liang

专题命中 预训练与数据 ：pretraining(title,abstract)；分类 cs.AI

Comments Accepted as a full paper by AAAI'25 - AI for Social Impact Track

On The Origin of Cultural Biases in Language Models: From Pre-training Data to Linguistic Phenomena

Tarek Naous, Wei Xu

专题命中 预训练与数据 ：language model(title,abstract)；分类 cs.CL

Evaluating Time Series Foundation Models on Noisy Periodic Time Series

Syamantak Datta Gupta

专题命中 预训练与数据 ：foundation model(title,abstract)；分类 cs.LG

Noise-Robust Target-Speaker Voice Activity Detection Through Self-Supervised Pretraining

Holger Severin Bovbjerg, Jan Østergaard, Jesper Jensen, Zheng-Hua Tan

专题命中 预训练与数据 ：pretraining(title,abstract)；分类 cs.LG

Comments Submitted to IEEE/ACM Transactions on Audio, Speech, and Language Processing for possible publication. 12 pages, 4 figures, 5 tables

Tuning Vision-Language Models with Candidate Labels by Prompt Alignment

Zhifang Zhang, Yuwei Niu, Xin Liu, Beibei Li

专题命中 预训练与数据 ：language model(title,abstract)；分类 cs.AI

LLM-Powered User Simulator for Recommender System

Zijian Zhang, Shuchang Liu, Ziru Liu, Rui Zhong, Qingpeng Cai, Xiangyu Zhao, Chunxu Zhang, Qidong Liu, Peng Jiang

专题命中 预训练与数据 ：LLM(title,abstract)；分类 cs.AI

Vision-and-Language Pretraining

Thong Nguyen, Cong-Duy Nguyen, Xiaobao Wu, See-Kiong Ng, Anh Tuan Luu

专题命中 预训练与数据 ：pretraining(title,abstract)；分类 cs.CL

Comments The content of the paper has been outdated. I would like to rewrite a new version with completely new information.

Why Fine-grained Labels in Pretraining Benefit Generalization?

Guan Zhe Hong, Yin Cui, Ariel Fuxman, Stanley Chan, Enming Luo

专题命中 预训练与数据 ：pretraining(title,abstract)；分类 cs.LG

Comments arXiv admin note: substantial text overlap with arXiv:2303.16887

When Vision Models Meet Parameter Efficient Look-Aside Adapters Without Large-Scale Audio Pretraining

Juan Yeo, Jinkwan Jang, Kyubyung Chae, Seongkyu Mun, Taesup Kim

专题命中 预训练与数据 ：pretraining(title,abstract)；分类 cs.LG

Comments 5 pages, 3 figures

Findings of the Second BabyLM Challenge: Sample-Efficient Pretraining on Developmentally Plausible Corpora

Michael Y. Hu, Aaron Mueller, Candace Ross, Adina Williams, Tal Linzen, Chengxu Zhuang, Ryan Cotterell, Leshem Choshen, Alex Warstadt, Ethan Gotlieb Wilcox

专题命中 预训练与数据 ：pretraining(title)；language model(abstract)；分类 cs.CL

Latent Neural Operator Pretraining for Solving Time-Dependent PDEs

Tian Wang, Chuang Wang

专题命中 预训练与数据 ：pretraining(title,abstract)；分类 cs.LG

From Goal-Conditioned to Language-Conditioned Agents via Vision-Language Models

Theo Cachet, Christopher R. Dance, Olivier Sigaud

专题命中 预训练与数据 ：language model(title,abstract)；分类 cs.AI