语言大模型 / LLM

Diversity-oriented Data Augmentation with Large Language Models

Zaitian Wang, Jinghan Zhang, Xinhao Zhang, Kunpeng Liu, Pengfei Wang, Yuanchun Zhou

机构 * Computer Network Information Center, CAS（中国科学院计算机网络信息中心） ； University of Chinese Academy of Sciences（中国科学院大学） ； Portland State University（波特兰州立大学） 纠错

专题命中 预训练与数据 ：large language model(title)；language model(title)；LLM(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to ACL 2025

On Pretraining for Project-Level Code Completion

Maksim Sapronov, Evgeniy Glukhov

机构 * JetBrains Research（JetBrains 研究） 纠错

专题命中 预训练与数据 ：pretraining(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.LG

BrainOmni: A Brain Foundation Model for Unified EEG and MEG Signals

Qinfan Xiao, Ziyun Cui, Chi Zhang, Siqi Chen, Wen Wu, Andrew Thwaites, Alexandra Woolgar, Bowen Zhou, Chao Zhang

机构 * Shanghai Artificial Intelligence Laboratory, China（上海人工智能实验室） ； Department of Electronic Engineering, Tsinghua University, China（清华大学电子工程系） ； Department of Psychology, University of Cambridge, UK（剑桥大学心理学系） ； Speech Hearing and Phonetic Sciences, University College London, UK（伦敦大学学院语音听力与语音科学系） ； MRC Cognition and Brain Sciences Unit, University of Cambridge, UK（剑桥大学MRC认知与脑科学单位） 纠错

专题命中 预训练与数据 ：foundation model(title,abstract)；pretraining(abstract)；分类 cs.LG

Comments Accepted by the 39th Conference on Neural Information Processing Systems (NeurIPS 2025)

Can Prompts Rewind Time for LLMs? Evaluating the Effectiveness of Prompted Knowledge Cutoffs

Xin Gao, Ruiyi Zhang, Daniel Du, Saurabh Mahindre, Sai Ashish Somayajula, Pengtao Xie

机构 * UC San Diego（UC圣迭戈大学） ； SUNY Buffalo（纽约州立大学布法罗分校） 纠错

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；pretraining(abstract)；prompting(abstract)

Comments Published at EMNLP 2025; Code and data available at https://github.com/gxx27/time_unlearn

Who Speaks for the Trigger? Dynamic Expert Routing in Backdoored Mixture-of-Experts Transformers

Xin Zhao, Xiaojun Chen, Bingshan Liu, Haoyu Gao, Zhendong Zhao, Yilong Chen

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；pretraining(abstract)

SeCon-RAG: A Two-Stage Semantic Filtering and Conflict-Free Framework for Trustworthy RAG

Xiaonan Si, Meilin Zhu, Simeng Qin, Lijia Yu, Lijun Zhang, Shuaitong Liu, Xinfeng Li, Ranjie Duan, Yang Liu, Xiaojun Jia

机构 * Institute of Software Chinese Academy of Sciences Beijing China（中国科学院软件研究所） ； Key Laboratory of System Software (Chinese Academy of Sciences) and State Key Laboratory of Computer Science, Institute of Software, Chinese Academy of Sciences, Beijing, China（中国科学院系统软件重点实验室和计算机科学国家重点实验室） ； University of Chinese Academy of Sciences, Beijing, China（中国科学院大学） ； Northeast University China（东北大学） ； Institute of Ai For industries Nanjing China（人工智能产业研究院） ； Southwest University China（西南大学） ； Nanyang Technological University Singapore（新加坡南洋理工大学） ； Alibaba China（阿里巴巴（中国）） 纠错

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments Accepted at NeurIPS 2025

Unifying Vision-Language Latents for Zero-label Image Caption Enhancement

Sanghyun Byun, Jung Ick Guack, Mohanad Odema, Baisub Lee, Jacob Song, Woo Seong Chung

机构 * LG Electronics USA（LG电子美国公司） 纠错

专题命中 预训练与数据 ：language model(abstract)；pretraining(abstract)；分类 cs.CL

Comments Accepted to PMLR and NeurIPS 2025 UniReps

MIRROR: Multimodal Cognitive Reframing Therapy for Rolling with Resistance

Subin Kim, Hoonrae Kim, Jihyun Lee, Yejin Jeon, Gary Geunbae Lee

机构 * KT Corporation, Republic of Korea（韩国KT公司） ； Graduate School of Artificial Intelligence, POSTECH, Republic of Korea（POSTECH人工智能研究生院） ； Computer Science and Engineering, POSTECH, Republic of Korea（POSTECH计算机科学与工程系） 纠错

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.AI

Comments EMNLP 2025 Main

Teaching Models to Understand (but not Generate) High-risk Data

Ryan Wang, Matthew Finlayson, Luca Soldaini, Swabha Swayamdipta, Robin Jia

机构 * Department of Computer Science, University of Southern California（计算机科学系，南加州大学） ； Allen Institute for AI（人工智能研究所） 纠错

专题命中 预训练与数据 ：language model(abstract)；分类 cs.CL、cs.LG

Scaling Vision Transformers for Functional MRI with Flat Maps

Connor Lane, Daniel Z. Kaplan, Tanishq Mathew Abraham, Paul S. Scotti

机构 * Baylor College of Medicine（贝勒医学院） ； University of Florida（佛罗里达大学） 纠错

专题命中 预训练与数据 ：foundation model(abstract,comments)；分类 cs.AI

Comments NeurIPS 2025 Workshop, Foundation Models for the Brain and Body; Code: https://github.com/MedARC-AI/fmri-fm; Discord: https://discord.gg/tVR4TWnRM9

Towards Multimodal Query-Based Spatial Audio Source Extraction

Chenxin Yu, Hao Ma, Xu Li, Xiao-Lei Zhang, Mingjie Shao, Chi Zhang, Xuelong Li

专题命中 预训练与数据 ：pretraining(abstract)

Comments Submitted to ICASSP 2026

SynDiff-AD: Improving Semantic Segmentation and End-to-End Autonomous Driving with Synthetic Data from Latent Diffusion Models

Harsh Goel, Sai Shankar Narasimhan, Oguzhan Akcin, Sandeep Chinchali

机构 * The University of Texas at Austin（德克萨斯大学奥斯汀分校） 纠错

专题命中 预训练与数据 ：prompting(abstract)

Comments 15 pages, 10 figures

From Literal to Liberal: A Meta-Prompting Framework for Eliciting Human-Aligned Exception Handling in Large Language Models

Imran Khan

机构 * Independent Researcher（独立研究者） 纠错

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；prompting(title,abstract)；SFT(abstract)

Comments 13 pages. Code and data are available at https://github.com/strongSoda/LITERAL-TO-LIBERAL

DSCD: Large Language Model Detoxification with Self-Constrained Decoding

Ming Dong, Jinkui Zhang, Bolong Zheng, Xinhui Tu, Po Hu, Tingting He

机构 * Hubei Provincial Key Laboratory of Artificial Intelligence and Smart Learning（湖北人工智能与智能学习省级重点实验室） ； National Language Resources Monitoring and Research Center for Network Media（网络媒体语言资源监测与研究国家中心） ； Central China Normal University（中央财经大学） ； Wuhan University of Technology（武汉理工大学） 纠错

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted at EMNLP 2025 MainConference

OS-HGAdapter: Open Semantic Hypergraph Adapter for Large Language Models Assisted Entropy-Enhanced Image-Text Alignment

Rongjun Chen, Chengsi Yao, Jinchang Ren, Xianxian Zeng, Peixian Wang, Jun Yuan, Jiawen Li, Huimin Zhao, Xu Lu

机构 * School of Computer Science, Guangdong Polytechnic Normal University（广东 polytechnic 正规大学计算机学院） 纠错

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Repurposing Annotation Guidelines to Instruct LLM Annotators: A Case Study

Kon Woo Kim, Rezarta Islamaj, Jin-Dong Kim, Florian Boudin, Akiko Aizawa

专题命中 指令微调 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments 11 pages, 2 figures, 3 tables, This is a preprint of the article accepted at NLDB 2025 (Springer LNCS). The final version is available at https://doi.org/10.1007/978-3-031-97144-0_13

Journal ref In International Conference on Applications of Natural Language to Information Systems, pp. 140-151. Cham: Springer Nature Switzerland, 2025

Self-Evolving LLMs via Continual Instruction Tuning

Jiazheng Kang, Le Huang, Cheng Hou, Zhe Zhao, Zhenxiang Yan, Ting Bai

机构 * Beijing University of Posts and Telecommunications（北京邮电大学） ； Tencent AI Lab（腾讯AI实验室） 纠错

专题命中 指令微调 ：instruction tuning(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

Protect: Towards Robust Guardrailing Stack for Trustworthy Enterprise LLM Systems

Karthik Avinash, Nikhil Pareek, Rishav Hada

机构 * FutureAGI Inc.（未来人工智能公司） 纠错

专题命中 指令微调 ：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Enabling Few-Shot Alzheimer's Disease Diagnosis on Biomarker Data with Tabular LLMs

Sophie Kearney, Shu Yang, Zixuan Wen, Bojian Hou, Duy Duong-Tran, Tianlong Chen, Jason Moore, Marylyn Ritchie, Li Shen

机构 * University of Pennsylvania（宾夕法尼亚大学） ； United States Naval Academy（美国海军学院） ； University of North Carolina at Chapel Hill（北卡罗来纳大学教堂山分校） ； Cedars Sinai Medical Center（西好莱坞 Cedars Sinai 医院） 纠错

专题命中 指令微调 ：LLM(abstract)；large language model(abstract)；language model(abstract)；foundation model(abstract)

Comments accepted by ACM-BCB'25: ACM Conference on Bioinformatics, Computational Biology, and Health Informatics [ACM SIGBio Best Paper Award]

Data-Efficient Fine-Tuning of Vision-Language Models for Diagnosis of Alzheimer's Disease

Fangqi Cheng, Surajit Ray, Xiaochen Yang

机构 * School of Mathematics and Statistics, University of Glasgow, UK（数学与统计学学院，格拉斯哥大学） 纠错

专题命中 指令微调 ：language model(title,abstract)

Comments Accepted at MICAD 2025

Geo-R1: Improving Few-Shot Geospatial Referring Expression Understanding with Reinforcement Fine-Tuning

Zilun Zhang, Zian Guan, Tiancheng Zhao, Haozhan Shen, Tianyu Li, Yuxiang Cai, Zhonggen Su, Zhaojun Liu, Jianwei Yin, Xiang Li

机构 * College of Computer Science and Technology of Zhejiang University（浙江大学计算机科学与技术学院） ； Polytechnic Institute of Zhejiang University（浙江大学Polytechnic学院） ； Om AI Research（Om AI研究机构） ； Binjiang Research Institute of Zhejiang University（浙江大学滨江研究机构） ； School of Software Engineering of Zhejiang University（浙江大学软件工程学院） ； School of Mathematical Sciences of Zhejiang University（浙江大学数学科学学院） ； China Academy of Space Technology（中国航天科技研究院） ； University of Bristol（布里斯托大学） 纠错

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；SFT(abstract)；分类 cs.AI

PIPer: On-Device Environment Setup via Online Reinforcement Learning

Alexander Kovrigin, Aleksandra Eliseeva, Konstantin Grotov, Egor Bogomolov, Yaroslav Zharov

机构 * JetBrains Research（JetBrains研究部） ； Constructor University（Constructor大学） ； Delft University of Technology（代尔夫特理工大学） 纠错

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

Comments Under review

I Have No Mouth, and I Must Rhyme: Uncovering Internal Phonetic Representations in LLaMA 3.2

Oliver McLaughlin, Arjun Khurana, Jack Merullo

机构 * Brown University（布朗大学） 纠错

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.LG

InternVLA-M1: A Spatially Guided Vision-Language-Action Framework for Generalist Robot Policy

Xinyi Chen, Yilun Chen, Yanwei Fu, Ning Gao, Jiaya Jia, Weiyang Jin, Hao Li, Yao Mu, Jiangmiao Pang, Yu Qiao, Yang Tian, Bin Wang, Bolun Wang, Fangjing Wang, Hanqing Wang, Tai Wang, Ziqin Wang, Xueyuan Wei, Chao Wu, Shuai Yang, Jinhui Ye, Junqiu Yu, Jia Zeng, Jingjing Zhang, Jinyu Zhang, Shi Zhang, Feng Zheng, Bowen Zhou, Yangkun Zhu

机构 * Intern Robotics Shanghai AI Laboratory（Intern Robotics上海AI实验室） 纠错

专题命中 指令微调 ：post-training(abstract)；prompting(abstract)；分类 cs.AI

Comments Technical report

Learning to Think: Information-Theoretic Reinforcement Fine-Tuning for LLMs

Jingyao Wang, Wenwen Qiang, Zeen Song, Changwen Zheng, Hui Xiong

机构 * Institute of Software, Chinese Academy of Sciences（中国科学院软件研究所） ； University of Chinese Academy of Sciences（中国科学院大学） ； The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州）） 纠错

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.LG

Comments Accepted by NeurIPS2025

Generative model for information metamaterial design

Jun Ming Hou, Long Chen, Xuan Zheng, Jia Wei Wu, Jian Wei You, Zi Xuan Cai, Jiahan Huang, Chen Xu Wu, Jian Lin Su, Lianlin Li, Jia Nan Zhang, Tie Jun Cui

专题命中 指令微调 ：foundation model(abstract)

Federated Fine-tuning of SAM-Med3D for MRI-based Dementia Classification

Kaouther Mouheb, Marawan Elbatel, Janne Papma, Geert Jan Biessels, Jurgen Claassen, Huub Middelkoop, Barbara van Munster, Wiesje van der Flier, Inez Ramakers, Stefan Klein, Esther E. Bron

机构 * Dept. of Radiology \& Nuclear Medicine, Erasmus MC, Rotterdam, the Netherlands The Hong Kong University of Science ； Technology, Hong Kong SAR Dept. of Neurology, Erasmus MC, Rotterdam, the Netherlands Dept. of Neurology, UMC Utrecht, Utrecht, the Netherlands Dept. of Geriatrics, Radboud UMC, Nijmegen, the Netherlands Dept. of Neurology, Leiden UMC, Leiden, the Netherlands Dept. of Internal Medicine, UMC Groningen, Groningen, the Netherlands Dept. of Neurology, Amsterdam UMC location VUmc, Amsterdam, the Netherlands Dept. of Psychiatry \& Psychology, Maastricht UMC, Maastricht, the Netherlands 纠错

专题命中 指令微调 ：foundation model(abstract)

Comments Accepted at the MICCAI 2025 Workshop on Distributed, Collaborative and Federated Learning (DeCAF)

DIP-R1: Deep Inspection and Perception with RL Looking Through and Understanding Complex Scenes

Sungjune Park, Hyunjun Kim, Junho Kim, Seongho Kim, Yong Man Ro

机构 * Integrated Vision and Language Lab., School of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST)（整合视觉与语言实验室，电气工程学院，韩国科学技术院（KAIST）） 纠错

专题命中 指令微调 ：SFT(abstract)

Offline and Online KL-Regularized RLHF under Differential Privacy

Yulian Wu, Rushil Thareja, Praneeth Vepakomma, Francesco Orabona

机构 * King Abdullah University of Science and Technology (KAUST)（卡布尔大学科学与技术学院） ； Mohamed bin Zayed University of Artificial Intelligence (MBZUAI)（穆罕默德·本·扎耶德人工智能大学） ； Massachusetts Institute of Technology (MIT)（麻省理工学院） 纠错

专题命中 后训练与偏好优化 ：RLHF(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

Information-Theoretic Reward Modeling for Stable RLHF: Detecting and Mitigating Reward Hacking

Yuchun Miao, Liang Ding, Sen Zhang, Rong Bao, Lefei Zhang, Dacheng Tao

专题命中 后训练与偏好优化 ：RLHF(title,abstract)；language model(abstract)；SFT(abstract)；分类 cs.LG

Comments 46 pages, 36 figures, submitted to IEEE Transactions on Pattern Analysis and Machine Intelligence