语言大模型 / LLM

Parameter Importance-Driven Continual Learning for Foundation Models

Lingxiang Wang, Hainan Zhang, Zhiming Zheng

机构 * Beijing Advanced Innovation Center for Future Blockchain and Privacy Computing, Beihang University（未来区块链与隐私计算先进创新中心，北京航空航天大学） ； School of Artificial Intelligence, Beihang University（人工智能学院，北京航空航天大学） 纠错

专题命中 预训练与数据 ：foundation model(title,abstract)；language model(abstract)；post-training(abstract)；分类 cs.AI、cs.LG

Cluster-based Adaptive Retrieval: Dynamic Context Selection for RAG Applications

Yifan Xu, Vipul Gupta, Rohit Aggarwal, Varsha Mahadevan, Bhaskar Krishnamachari

机构 * University of Southern California（美国南加州大学） 纠错

专题命中 预训练与数据 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

When Words Change the Model: Sensitivity of LLMs for Constraint Programming Modelling

Alessio Pellegrino, Jacopo Mauro

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

MergeDNA: Context-aware Genome Modeling with Dynamic Tokenization through Token Merging

Siyuan Li, Kai Yu, Anna Wang, Zicheng Liu, Chang Yu, Jingbo Zhou, Qirong Yang, Yucheng Guo, Xiaoming Zhang, Stan Z. Li

专题命中 预训练与数据 ：language model(abstract)；foundation model(abstract)；分类 cs.AI、cs.LG

Comments AAAI 2026 (Oral Presentation) Preprint

The Learning Dynamics of Subword Segmentation for Morphologically Diverse Languages

Francois Meyer, Jan Buys

机构 * Department of Computer Science University of Cape Town（计算机科学系 哥伦比亚大学） 纠错

专题命中 预训练与数据 ：language model(abstract)；pretraining(abstract)；分类 cs.CL

Auden-Voice: General-Purpose Voice Encoder for Speech and Language Understanding

Mingyue Huo, Wei-Cheng Tseng, Yiwen Shao, Hao Zhang, Dong Yu

机构 * University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校） ； University of Texas at Austin（德克萨斯大学奥斯汀分校） ； Tencent AI Lab, USA（腾讯AI实验室（美国）） 纠错

专题命中 预训练与数据 ：language model(abstract)；pretraining(abstract)

Comments Submitted to ICASSP2026

Step-Audio-EditX Technical Report

Chao Yan, Boyong Wu, Peng Yang, Pengfei Tan, Guoqiang Hu, Li Xie, Yuxin Zhang, Xiangyu, Zhang, Fei Tian, Xuerui Yang, Xiangyu Zhang, Daxin Jiang, Shuchang Zhou, Gang Yu

机构 * StepFun 纠错

专题命中 预训练与数据 ：LLM(abstract)；分类 cs.CL、cs.AI

ReassembleNet: Learnable Keypoints and Diffusion for 2D Fresco Reconstruction

Adeela Islam, Stefano Fiorini, Stuart James, Pietro Morerio, Alessio Del Bue

机构 * Fondazione Istituto Italiano di Tecnologia（意大利技术研究院） ； University of Genova（热那亚大学） ； Durham University（杜伦大学） 纠错

专题命中 预训练与数据 ：pretraining(abstract)

FarSLIP: Discovering Effective CLIP Adaptation for Fine-Grained Remote Sensing Understanding

Zhenshi Li, Weikang Yu, Dilxat Muhtar, Xueliang Zhang, Pengfeng Xiao, Pedram Ghamisi, Xiao Xiang Zhu

机构 * Nanjing University（南京大学） ； Technical University of Munich（慕尼黑技术大学） ； Helmholtz-Zentrum Dresden-Rossendorf（德累斯顿-罗斯托克亥姆霍兹中心） 纠错

专题命中 预训练与数据 ：pretraining(abstract)

GeoSceneGraph: Geometric Scene Graph Diffusion Model for Text-guided 3D Indoor Scene Synthesis

Antonio Ruiz, Tao Wu, Andrew Melnik, Qing Cheng, Xuqin Wang, Lu Liu, Yongliang Wang, Yanfeng Zhang, Helge Ritter

机构 * Huawei Technologies（华为技术有限公司） ； Center for Cognitive Interaction Technology (CITEC), Bielefeld University（认知交互技术中心（CITEC），比勒菲尔德大学） 纠错

专题命中 预训练与数据 ：language model(abstract)

Towards Alignment-Centric Paradigm: A Survey of Instruction Tuning in Large Language Models

Xudong Han, Junjie Yang, Tianyang Wang, Ziqian Bi, Xinyuan Song, Junfeng Hao, Junhao Song

机构 * Department of Informatics, University of Sussex（信息学院，苏塞克斯大学） ； Pingtan Research Institute, Xiamen University（平潭研究院，厦门大学） ； Department of Computer Science, University of Liverpool（计算机科学系，利物浦大学） ； Department of Computer Science, Purdue University（计算机科学系，普渡大学） ； Department of Computer Science, Emory University（计算机科学系，埃默里大学） ； AI Agent Lab, Vokram Group（AI代理实验室，Vokram集团） ； Department of Computing, Imperial College London（计算系，帝国理工学院伦敦分校） 纠错

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；instruction tuning(title,abstract)；分类 cs.CL

Comments 24 pages, 7 figures, 5 tables

Multi-Agent Debate Strategies to Enhance Requirements Engineering with Large Language Models

Marc Oriol, Quim Motger, Jordi Marco, Xavier Franch

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)

Privacy Preserving In-Context-Learning Framework for Large Language Models

Bishnu Bhusal, Manoj Acharya, Ramneet Kaur, Colin Samplawski, Anirban Roy, Adam D. Cobb, Rohit Chadha, Susmit Jha

机构 * SRI 纠错

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

Comments Git repo: https://github.com/bhusalb/privacy-preserving-icl

FANAL -- Financial Activity News Alerting Language Modeling Framework

Urjitkumar Patel, Fang-Chun Yeh, Chinmay Gondhalekar, Hari Nalluri

专题命中 指令微调 ：language model(title,abstract)；large language model(abstract,comments)；preference optimization(abstract)；分类 cs.CL、cs.LG

Comments Accepted for the IEEE International Workshop on Large Language Models for Finance, 2024. This is a preprint version

Journal ref 2024 IEEE International Conference on Big Data, Dec 15-18, 2024, Electronic ISBN: 979-8-3503-6248-0, Electronic ISSN: 2573-2978

Communication-Pipelined Split Federated Learning for Foundation Model Fine-Tuning in UAV Networks

Zizhen Zhou, Ying-Chang Liang, Yanyu Cheng, Wei Yang Bryan Lim

专题命中 指令微调 ：foundation model(title,abstract)

Comments This work has been submitted to the IEEE for possible publication

Where does an LLM begin computing an instruction?

Aditya Pola, Vineeth N. Balasubramanian

机构 * Indian Institute of Technology, Hyderabad（印度海得拉巴印度理工学院） 纠错

专题命中 指令微调 ：LLM(title)；分类 cs.CL

Comments Extended Abstract accepted at UniReps '25 Workshop

Zero-Shot Open-Vocabulary Human Motion Grounding with Test-Time Training

零样本开放词汇人体运动接地与测试时训练

Yunjiao Zhou, Xinyan Chen, Junlang Qian, Lihua Xie, Jianfei Yang

专题命中 指令微调 ：large language model(abstract)；language model(abstract)

AI总结 本文提出ZOMG框架，通过语言语义分区和软掩码优化，在无需标注或微调的情况下实现零样本开放词汇的人体运动接地，提升了运动理解的性能和效率。

DEPO: Dual-Efficiency Preference Optimization for LLM Agents

DEPO：用于LLM代理的双效偏好优化

Sirui Chen, Mengshi Zhao, Lei Xu, Yuying Zhao, Beier Zhu, Hanwang Zhang, Shengjie Zhao, Chaochao Lu

专题命中 后训练与偏好优化 ：LLM(title,abstract)；preference optimization(title,abstract)；large language model(abstract)；language model(abstract)

AI总结 DEPO通过双效偏好优化方法提升LLM代理的效率和性能，减少token和步骤消耗，同时在多个基准测试中表现优异。

Comments Accepted to AAAI 2026

GRPO-RM: Fine-Tuning Representation Models via GRPO-Driven Reinforcement Learning

Yanchen Xu, Ziheng Jiao, Hongyuan Zhang, Xuelong Li

机构 * Institute of Artificial Intelligence (TeleAI), China Telecom（人工智能研究院（TeleAI），中国电信） ； School of Artificial Intelligence, OPtics and ElectroNics (iOPEN), Northwestern Polytechnical University（人工智能学院（iOPEN），西北工业大学） ； HuaWei Technologies Co., Ltd.（华为技术有限公司） ； The University of Hong Kong（香港大学） 纠错

专题命中 后训练与偏好优化 ：large language model(abstract)；language model(abstract)；post-training(abstract)；分类 cs.LG

Core Safety Values for Provably Corrigible Agents

Aran Nayebi

机构 * Aran Nayebi（独立研究者） 纠错

专题命中 后训练与偏好优化 ：RLHF(abstract)；分类 cs.AI、cs.LG

Comments 14 pages. To appear in AAAI 2026 Machine Ethics Workshop (W37) Proceedings

Aligning Generative Music AI with Human Preferences: Methods and Challenges

Dorien Herremans, Abhinaba Roy

专题命中 后训练与偏好优化 ：preference optimization(abstract)；分类 cs.AI

Comments Accepted at the AAAI-2026 Senior Member Track

irace-evo: Automatic Algorithm Configuration Extended With LLM-Based Code Evolution

Camilo Chacón Sartori, Christian Blum

机构 * Catalan Institute of Nanoscience and Nanotechnology (ICN2), CSIC and BIST（加泰罗尼亚纳米科学与纳米技术研究所（ICN2）、西班牙国家科研学院（CSIC）和巴塞罗那技术研究所（BIST）） ； Artificial Intelligence Research Institute (IIIA-CSIC)（人工智能研究所（IIIA-CSIC）） 纠错

专题命中 长上下文与记忆 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Hierarchical Token Prepending: Enhancing Information Flow in Decoder-based LLM Embeddings

Xueying Ding, Xingyue Huang, Mingxuan Ju, Liam Collins, Yozen Liu, Leman Akoglu, Neil Shah, Tong Zhao

机构 * Carnegie Mellon University（卡内基梅隆大学） ； University of Oxford（牛津大学） ； Snap Inc（Snap公司） 纠错

专题命中 长上下文与记忆 ：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.LG

Eguard: Defending LLM Embeddings Against Inversion Attacks via Text Mutual Information Optimization

Tiantian Liu, Hongwei Yao, Feng Lin, Tong Wu, Zhan Qin, Kui Ren

专题命中 长上下文与记忆 ：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Teaching According to Students' Aptitude: Personalized Mathematics Tutoring via Persona-, Memory-, and Forgetting-Aware LLMs

Yang Wu, Rujing Yao, Tong Zhang, Yufei Shi, Zhuoren Jiang, Zhushan Li, Xiaozhong Liu

专题命中 长上下文与记忆 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments AAAI 2026 Workshop

Agent-SAMA: State-Aware Mobile Assistant

Linqiang Guo, Wei Liu, Yi Wen Heng, Tse-Hsun, Chen, Yang Wang

专题命中 长上下文与记忆 ：large language model(abstract)；language model(abstract)；分类 cs.AI

Comments Accepted to AAAI-26 (Main Technical Track)

Bias after Prompting: Persistent Discrimination in Large Language Models

Nivedha Sivakumar, Natalie Mackraz, Samira Khorshidi, Krishna Patel, Barry-John Theobald, Luca Zappella, Nicholas Apostoloff

机构 * Apple（苹果公司） 纠错

专题命中 推理与问题求解 ：large language model(title,abstract)；language model(title,abstract)；prompting(title,abstract)；分类 cs.CL、cs.LG

Leveraging the Power of Large Language Models in Entity Linking via Adaptive Routing and Targeted Reasoning

Yajie Li, Albert Galimov, Mitra Datta Ganapaneni, Pujitha Thejaswi, De Meng, Priyanshu Kumar, Saloni Potdar

机构 * College of Information and Computer Sciences, University of Massachusetts Amherst（信息与计算机科学学院，马萨诸塞大学阿默斯特分校） ； Apple（苹果公司） 纠错

专题命中 推理与问题求解 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；prompting(abstract)

Comments Accepted to EMNLP 2025 Industry Track

Knowledge-Grounded Agentic Large Language Models for Multi-Hazard Understanding from Reconnaissance Reports

Chenchen Kuai, Zihao Li, Braden Rosen, Stephanie Paal, Navid Jafari, Jean-Louis Briaud, Yunlong Zhang, Youssef M. A. Hashash, Yang Zhou

机构 * organization= Department One , addressline= Address One , city= City One , postcode= 00000 , state= State One , country= Country One ； organization= Department Two , addressline= Address Two , city= City Two , postcode= 22222 , state= State Two , country= Country Two ； organization= Zachry Department of Civil \& Environmental Engineering, Texas A\&M University , addressline= 3136 TAMU , city= College Station , postcode= 77843 , state= TX , country= USA ； organization= Department of Engineering Technology ； Industrial Distribution, Texas A\&M University , city= College Station , postcode= 77843 , state= TX , country= USA ； organization= Department of Civil ； Environmental Engineering, University of Illinois Urbana-Champaign , city= Urbana , postcode= 61801 , state= IL , country= USA 纠错

专题命中 推理与问题求解 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments 17 pages, 5 figures

Socrates or Smartypants: Testing Logic Reasoning Capabilities of Large Language Models with Logic Programming-based Test Oracles

Zihao Xu, Junchen Ding, Yiling Lou, Kun Zhang, Dong Gong, Yuekang Li

专题命中 推理与问题求解 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL