语言大模型 / LLM

VITA: Variational Pretraining of Transformers for Climate-Robust Crop Yield Forecasting

Adib Hasan, Mardavij Roozbehani, Munther Dahleh

专题命中 预训练与数据 ：pretraining(title,abstract)；分类 cs.LG

Towards Universal Neural Operators through Multiphysics Pretraining

Mikhail Masliaev, Dmitry Gusarov, Ilya Markov, Alexander Hvatov

机构 * ITMO University（ITMO大学） 纠错

专题命中 预训练与数据 ：pretraining(title)；分类 cs.LG

Comments 5 pages, 1 figure, accepted for Machine Learning and the Physical Sciences Workshop, NeurIPS 2025

SIMS-V: Simulated Instruction-Tuning for Spatial Video Understanding

Ellis Brown, Arijit Ray, Ranjay Krishna, Ross Girshick, Rob Fergus, Saining Xie

机构 * New York University（纽约大学） ； Boston University（波士顿大学） ； AllenAI ； Vercept 纠错

专题命中 预训练与数据 ：LLM(abstract)；language model(abstract)

Comments Project page: https://ellisbrown.github.io/sims-v

LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristics

Randall Balestriero, Yann LeCun

机构 * Brown University（布朗大学） ； New York University (NYU)（纽约大学） ； Meta-FAIR 纠错

专题命中 预训练与数据 ：pretraining(abstract)；分类 cs.AI、cs.LG

Harnessing Bounded-Support Evolution Strategies for Policy Refinement

Ethan Hirschowitz, Fabio Ramos

机构 * The University of Sydney（悉尼大学） ； NVIDIA（NVIDIA公司） 纠错

专题命中 预训练与数据 ：pretraining(abstract)；分类 cs.AI、cs.LG

Comments 10 pages, 6 figures, to be published in Australasian Conference on Robotics and Automation (ACRA 2025)

Pretrained Joint Predictions for Scalable Batch Bayesian Optimization of Molecular Designs

Miles Wang-Henderson, Benjamin Kaufman, Edward Williams, Ryan Pederson, Matteo Rossi, Owen Howell, Carl Underkoffler, Narbe Mardirossian, John Parkhill

专题命中 预训练与数据 ：foundation model(abstract)；分类 cs.LG

ModernBERT or DeBERTaV3? Examining Architecture and Data Influence on Transformer Encoder Models Performance

Wissam Antoun, Benoît Sagot, Djamé Seddah

机构 * Inria（法国国家信息与自动化技术研究院） 纠错

专题命中 预训练与数据 ：pretraining(abstract)；分类 cs.CL

Comments Published as a conference paper at IJCNLP-AACL 2025

CLIPPan: Adapting CLIP as A Supervisor for Unsupervised Pansharpening

Lihua Jian, Jiabo Liu, Shaowu Wu, Lihui Chen

专题命中 预训练与数据 ：language model(abstract)；分类 cs.AI

Comments Accepted to AAAI 2026