语言大模型 / LLM

On the generalization of language models from in-context learning and finetuning: a controlled study

Andrew K. Lampinen, Arslan Chaudhry, Stephanie C. Y. Chan, Cody Wild, Diane Wan, Alex Ku, Jörg Bornschein, Razvan Pascanu, Murray Shanahan, James L. McClelland

机构 * Google DeepMind（谷歌DeepMind） ； Google DeepMind & Stanford University（谷歌DeepMind与斯坦福大学） 纠错

专题命中 预训练与数据 ：language model(title,abstract)；large language model(abstract)；pretraining(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments FoRLM workshop, NeurIPS 2025

Do Syntactic Categories Help in Developmentally Motivated Curriculum Learning for Language Models?

Arzu Burcu Güven, Anna Rogers, Rob van der Goot

机构 * IT University of Copenhagen（哥本哈根IT大学） 纠错

专题命中 预训练与数据 ：language model(title)；分类 cs.CL

Journal ref Proceedings of the First BabyLM Workshop 2025

Private-RAG: Answering Multiple Queries with LLMs while Keeping Your Data Private

Ruihan Wu, Erchi Wang, Zhiyuan Zhang, Yu-Xiang Wang

机构 * Computer Science and Engineering University of California, San Diego（计算机科学与工程大学加州大学圣地亚哥分校） ； Halıcıoğlu Data Science Institute University of California, San Diego（Halıcıoğlu数据科学研究所加州大学圣地亚哥分校） ； Department of Computer Science University of California, Los Angeles（计算机科学系加州大学洛杉矶分校） 纠错

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

It Takes Two: A Dual Stage Approach for Terminology-Aware Translation

Akshat Singh Jaswal

机构 * PES University（PES大学） 纠错

专题命中 预训练与数据 ：LLM(abstract)；分类 cs.CL、cs.AI

Comments Accepted to WMT 2025. Code availavle at https://github.com/akshat-sj/duterm

Journal ref In Proceedings of the Tenth Conference on Machine Translation, pages 1344-1350, Suzhou, China. Association for Computational Linguistics (2025)

Laytrol: Preserving Pretrained Knowledge in Layout Control for Multimodal Diffusion Transformers

Sida Huang, Siqi Huang, Ping Luo, Hongyuan Zhang

专题命中 预训练与数据 ：pretraining(abstract)

Comments Accepted by AAAI 2026

Quantum-centric machine learning for molecular dynamics

Yanxian Tao, Lingyun Wan, Xiongzhi Zeng, Yingdi Jin, Jie Liu, Zhenyu Li, Jinlong Yang

专题命中 预训练与数据 ：pretraining(abstract)

Heuristic Time Complexity of NISQ Shortest-Vector-Problem Solvers

Miloš Prokop, Petros Wallden

专题命中 预训练与数据 ：pretraining(abstract)

Comments 33pages, 5figures

Journal ref IEEE Transactions on Quantum Engineering, vol. 6, pp. 1-19 (2025)

Instruction Tuning and CoT Prompting for Contextual Medical QA with LLMs

Chenqian Le, Ziheng Gong, Chihang Wang, Haowei Ni, Panfeng Li, Xupeng Chen

机构 * New York University（纽约大学） ； Columbia University（哥伦比亚大学） ； University of Michigan（密歇根大学） 纠错

专题命中 指令微调 ：instruction tuning(title,abstract)；prompting(title,abstract)；large language model(abstract)；language model(abstract)

Comments Accepted by 2025 International Conference on Artificial Intelligence, Human-Computer Interaction and Natural Language Processing

Journal ref Proceedings of the 2025 International Conference on Artificial Intelligence, Human-Computer Interaction and Natural Language Processing (ICAHN), 2025, pp. 43-46

A Causal-Guided Multimodal Large Language Model for Generalized Power System Time-Series Data Analytics

Zhenghao Zhou, Yiyan Li, Xinjie Yu, Runlong Liu, Zelin Guo, Zheng Yan, Mo-Yuen Chow, Yuqi Yang, Yang Xu

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Think Before You Retrieve: Learning Test-Time Adaptive Search with Small Language Models

Supriti Vijay, Aman Priyanshu, Anu Vellore, Baturay Saglam, Amin Karbasi

机构 * Carnegie Mellon University（卡内基梅隆大学） ； Foundation AI–Cisco Systems Inc.（Foundation AI–Cisco 系统公司） ； Yale University（耶鲁大学） 纠错

专题命中 指令微调 ：language model(title,abstract)；small language model(title)；large language model(abstract)；分类 cs.CL、cs.AI

Comments 37 images, 7 figures, and 15 tables

Comparing Reconstruction Attacks on Pretrained Versus Full Fine-tuned Large Language Model Embeddings on Homo Sapiens Splice Sites Genomic Data

Reem Al-Saidi, Erman Ayday, Ziad Kobti

机构 * School of Computer Science University of Windsor（计算机科学学院 温莎大学） 纠错

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.LG

Selection of LLM Fine-Tuning Data based on Orthogonal Rules

Xiaomin Li, Mingye Gao, Zhiwei Zhang, Chang Yue, Hong Hu

专题命中 指令微调 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Beyond Correctness: Evaluating and Improving LLM Feedback in Statistical Education

Niklas Ippisch, Markus Herklotz, Anna-Carolina Haensch, Carsten Schwemmer

专题命中 指令微调 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；prompting(abstract)

OpenVLThinker: Complex Vision-Language Reasoning via Iterative SFT-RL Cycles

Yihe Deng, Hritik Bansal, Fan Yin, Nanyun Peng, Wei Wang, Kai-Wei Chang

专题命中 指令微调 ：SFT(title,abstract)；language model(abstract)；分类 cs.CL

Comments 23 pages, 11 figures, 8 tables

Motif 2 12.7B technical report

Junghwan Lim, Sungmin Lee, Dongseok Kim, Taehyun Kim, Eunhwan Park, Jeesoo Lee, Jeongdoo Lee, Junhyeok Lee, Wai Ting Cheung, Dahye Choi, Jaeheui Her, Jaeyeon Huh, Hanbin Jung, Changjin Kang, Beomgyu Kim, Minjae Kim, Taewhan Kim, Youngrok Kim, Hyukjin Kweon, Haesol Lee, Kungyu Lee, Dongpin Oh, Yeongjae Park, Bokki Ryu, Dongjoo Weon

机构 * Motif Technologies（Motif技术公司） 纠错

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；foundation model(abstract)；post-training(abstract)

Still Not There: Can LLMs Outperform Smaller Task-Specific Seq2Seq Models on the Poetry-to-Prose Conversion Task?

Kunal Kingkar Das, Manoj Balaji Jagadeeshan, Nallani Chakravartula Sahith, Jivnesh Sandhan, Pawan Goyal

专题命中 指令微调 ：LLM(abstract)；large language model(abstract)；language model(abstract)；prompting(abstract)

The Path Not Taken: RLVR Provably Learns Off the Principals

Hanqing Zhu, Zhenyu Zhang, Hanxian Huang, DiJia Su, Zechun Liu, Jiawei Zhao, Igor Fedorov, Hamed Pirsiavash, Zhizhou Sha, Jinwon Lee, David Z. Pan, Zhangyang Wang, Yuandong Tian, Kai Sheng Tai

机构 * Meta AI ； The University of Texas at Austin（德克萨斯大学奥斯汀分校） 纠错

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；SFT(abstract)；分类 cs.AI、cs.LG

Comments Preliminary version accepted as a spotlight in NeurIPS 2025 Workshop on Efficient Reasoning

Aspect-Oriented Summarization for Psychiatric Short-Term Readmission Prediction

WonJin Yoon, Boyu Ren, Spencer Thomas, Chanhwi Kim, Guergana Savova, Mei-Hua Hall, Timothy Miller

专题命中 指令微调 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL

Comments Published in Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing (EMNLP 2025, Main Track)

Journal ref In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, pages 28025-28042, Suzhou, China. Association for Computational Linguistics

RESTL: Reinforcement Learning Guided by Multi-Aspect Rewards for Signal Temporal Logic Transformation

Yue Fang, Jin Zhi, Jie An, Hongshen Chen, Xiaohong Chen, Naijun Zhan

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；SFT(abstract)

Comments 12 pages, 4 figures

Testing Question Answering Software with Context-Driven Question Generation

Shuang Liu, Zhirun Zhang, Jinhao Dong, Zan Wang, Qingchao Shen, Junjie Chen, Wei Lu, Xiaoyong Du

专题命中 指令微调 ：LLM(abstract)；large language model(abstract)；language model(abstract)

RSVG-ZeroOV: Exploring a Training-Free Framework for Zero-Shot Open-Vocabulary Visual Grounding in Remote Sensing Images

Ke Li, Di Wang, Ting Wang, Fuyu Dong, Yiming Zhang, Luyao Zhang, Xiangyu Wang, Shaofeng Li, Quan Wang

专题命中 指令微调 ：language model(abstract)；foundation model(abstract)；分类 cs.AI

Comments This work is accepted by AAAI 2026

VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuning

Xinhao Li, Ziang Yan, Desen Meng, Lu Dong, Xiangyu Zeng, Yinan He, Yali Wang, Yu Qiao, Yi Wang, Limin Wang

机构 * Shanghai AI Laboratory（上海人工智能实验室） ； Nanjing University（南京大学） ； Zhejiang University（浙江大学） ； University of Science and Technology of China（中国科学技术大学） ； Shanghai Innovation Institute（上海创新研究院） ； Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences（中国科学院深圳先进技术研究所） 纠错

专题命中 指令微调 ：large language model(abstract)；language model(abstract)

Zeroth-Order Optimization Finds Flat Minima

Liang Zhang, Bingcong Li, Kiran Koshy Thekumparampil, Sewoong Oh, Michael Muehlebach, Niao He

机构 * Department of Computer Science, ETH Zurich（苏黎世联邦理工学院计算机科学系） ； Max Planck Institute for Intelligent Systems（智能系统马克斯·普朗克研究所） ； Amazon（亚马逊公司） ； Paul G. Allen School of Computer Science and Engineering, University of Washington（华盛顿大学保罗·G·阿伦计算机科学与工程学校） 纠错

专题命中 指令微调 ：language model(abstract)；分类 cs.AI、cs.LG

Comments NeurIPS 2025

Generalizing Verifiable Instruction Following

Valentina Pyatkin, Saumya Malik, Victoria Graf, Hamish Ivison, Shengyi Huang, Pradeep Dasigi, Nathan Lambert, Hannaneh Hajishirzi

机构 * Allen Institute for Artificial Intelligence（艾伦人工智能研究所） ； University of Washington（华盛顿大学） 纠错

专题命中 指令微调 ：language model(abstract)；分类 cs.CL

Comments 11 pages, accepted to NeurIPS 2025, Datasets & Benchmarks

MIDB: Multilingual Instruction Data Booster for Enhancing Cultural Equality in Multilingual Instruction Synthesis

Yilun Liu, Chunguang Zhao, Xinhua Yang, Hongyong Zeng, Shimin Tao, Weibin Meng, Minggui He, Yan Yu, Hongxia Ma, Li Zhang, Daimeng Wei, Boxing Chen

专题命中 指令微调 ：instruction tuning(abstract)；分类 cs.CL

Comments accepted by AAAI 2026

p2-TQA: A Process-based Preference Learning Framework for Self-Improving Table Question Answering Models

Wei Zhou, Mohsen Mesgar, Heike Adel, Annemarie Friedrich

机构 * Bosch Center for Artificial Intelligence（博世人工智能中心） ； Hochschule der Medien（媒体高等学校） ； University of Augsburg（艾格学院） 纠错

专题命中 指令微调 ：post-training(abstract)；分类 cs.CL

Comments Accepted at AACL-IJCNLP

Empowering DINO Representations for Underwater Instance Segmentation via Aligner and Prompter

Zhiyang Chen, Chen Zhang, Hao Fang, Runmin Cong

专题命中 指令微调 ：foundation model(abstract)

Comments AAAI 2026

Beyond Correctness: Confidence-Aware Reward Modeling for Enhancing Large Language Model Reasoning

Qianxi He, Qingyu Ren, Shanzhe Lei, Xuhong Wang, Yingchun Wang

机构 * Shanghai Artificial Intelligence Laboratory（上海人工智能实验室） ； Shanghai Key Laboratory of Data Science, School of Computer Science, Fudan University（上海数据科学关键实验室，计算机科学学院，复旦大学） 纠错

专题命中 后训练与偏好优化 ：large language model(title,abstract)；language model(title,abstract)；instruction tuning(abstract)；post-training(abstract)

CAPO: Confidence Aware Preference Optimization Learning for Multilingual Preferences

Rhitabrat Pokharel, Yufei Tao, Ameeta Agrawal

机构 * Department of Computer Science（计算机科学系） 纠错

专题命中 后训练与偏好优化 ：preference optimization(title,abstract)；large language model(abstract)；language model(abstract)；post-training(abstract)

Comments Accepted at IJCNLP-AACL 2025 Findings

SAFENLIDB: A Privacy-Preserving Safety Alignment Framework for LLM-based Natural Language Database Interfaces

Ruiheng Liu, XiaoBing Chen, Jinyu Zhang, Qiongwen Zhang, Yu Zhang, Bailong Yang

专题命中 后训练与偏好优化 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；preference optimization(abstract)

Comments AAAI 2026 Extended Version