语言大模型 / LLM

Retrieval augmented generation based dynamic prompting for few-shot biomedical named entity recognition using large language models

Yao Ge, Sudeshna Das, Yuting Guo, Abeed Sarker

机构 * Department of Biomedical Informatics, School of Medicine, Emory University（生物医学信息学系，医学院，埃默里大学） ； Department of Computer Science, Emory University（计算机科学系，埃默里大学） ； National Library of Medicine, National Institutes of Health（国家医学图书馆，国立卫生研究院） ； Department of Biomedical Engineering, Georgia Institute of Technology and Emory University（生物医学工程系，佐治亚理工学院和埃默里大学） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；prompting(title,abstract)；分类 cs.CL、cs.AI

Comments 31 pages, 4 figures, 15 tables

ALOPE: Adaptive Layer Optimization for Translation Quality Estimation using Large Language Models

Archchana Sindhujan, Shenbin Qian, Chan Chi Chun Matthew, Constantin Orasan, Diptesh Kanojia

机构 * Institute for People-Centred AI and Centre for Translation Studies, School of Computer Science and Electronic Engineering, University of Surrey（以人为本的人工智能研究所和翻译研究中心，计算机科学与电子工程学院，萨里大学） 纠错

专题命中 预训练与数据 ：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Accepted to COLM 2025 Conference

How Chinese are Chinese Language Models? The Puzzling Lack of Language Policy in China's LLMs

Andrea W Wen-Yi, Unso Eun Seo Jo, Lu Jia Lin, David Mimno

专题命中 预训练与数据 ：language model(title,abstract)；LLM(abstract)；pretraining(abstract)；分类 cs.CL

Comments We have reworked the paper substantially. Please refer to the new, updated article: arXiv:2504.00289

Enhancing Rumor Detection Methods with Propagation Structure Infused Language Model

Chaoqun Cui, Siyuan Li, Kunkun Ma, Caiyan Jia

机构 * School of Computer Science and Technology & Beijing Key Lab of Traffic Data Analysis and Mining（计算机科学与技术学院及北京交通数据与挖掘重点实验室） 纠错

专题命中 预训练与数据 ：language model(title,abstract)；pretraining(abstract)；分类 cs.CL

Comments This paper is accepted by COLING2025

Journal ref Proceedings of the 31st International Conference on Computational Linguistics. 2025: 7165-7179

Effortless Vision-Language Model Specialization in Histopathology without Annotation

Jingna Qiu, Nishanth Jain, Jonas Ammeling, Marc Aubreville, Katharina Breininger

机构 * Friedrich-Alexander-Universität Erlangen-Nürnberg（弗里德里希-亚历山大-厄林根-纽伦堡大学） ； Ingolstadt University of Applied Sciences（因戈尔施塔特应用科学大学） ； Flensburg University of Applied Sciences（弗拉森堡应用科学大学） ； Julius-Maximilians-Universität Würzburg（朱利叶斯-马克斯-魏扎克大学） 纠错

专题命中 预训练与数据 ：language model(title,abstract)；pretraining(abstract)

Interleaved Speech-Text Language Models for Simple Streaming Text-to-Speech Synthesis

Yifan Yang, Shujie Liu, Jinyu Li, Hui Wang, Lingwei Meng, Haiyang Sun, Yuzhe Liang, Ziyang Ma, Yuxuan Hu, Rui Zhao, Jianwei Yu, Yan Lu, Xie Chen

专题命中 预训练与数据 ：language model(title,abstract)；large language model(abstract)

The Art of Breaking Words: Rethinking Multilingual Tokenizer Design

Aamod Thakur, Ajay Nagpal, Atharva Savarkar, Kundeshwar Pundalik, Siddhesh Dosi, Piyush Sawarkar, Viraj Thakur, Rohit Saluja, Maunendra Sankar Desarkar, Ganesh Ramakrishnan

机构 * BharatGen Team（BharatGen团队） 纠错

专题命中 预训练与数据 ：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Dynamic Pattern Alignment Learning for Pretraining Lightweight Human-Centric Vision Models

Xuanhan Wang, Huimin Deng, Ke Liu, Jun Wang, Lianli Gao, Jingkuan Song

机构 * Tongji University（同济大学） ； University of Electronic Science and Technology of China（电子科技大学） 纠错

专题命中 预训练与数据 ：pretraining(title,abstract)

VA-Blueprint: Uncovering Building Blocks for Visual Analytics System Design

Leonardo Ferreira, Gustavo Moreira, Fabio Miranda

机构 * University of Illinois Chicago（伊利诺伊大学芝加哥分校） 纠错

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.AI

Comments Accepted at IEEE VIS 2025. VA-Blueprint is available at https://urbantk.org/va-blueprint

RAIR: Retrieval-Augmented Iterative Refinement for Chinese Spelling Correction

Junhong Liang, Yu Zhou

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.CL

Griffon v2: Advancing Multimodal Perception with High-Resolution Scaling and Visual-Language Co-Referring

Yufei Zhan, Shurong Zheng, Yousong Zhu, Hongyin Zhao, Fan Yang, Ming Tang, Jinqiao Wang

机构 * Foundation Model Research Center, Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所基础模型研究中心） ； School of Artificial Intelligence, University of Chinese Academy of Sciences（中国科学院大学人工智能学院） ； Peng Cheng Laboratory, Shenzhen, China（鹏城实验室） ； Wuhan AI Research, Wuhan, China（武汉人工智能研究所） 纠错

专题命中 预训练与数据 ：large language model(abstract)；language model(abstract)；分类 cs.AI

Comments Accepted by ICCV 2025. Codes and datasets are released at https://github.com/jefferyZhan/Griffon

ScaffoldGPT: A Scaffold-based GPT Model for Drug Optimization

Xuefeng Liu, Songhao Jiang, Ian Foster, Jinbo Xu, Rick Stevens

机构 * Argonne National Laboratory（阿贡国家实验室） ； Toyota Technological Institute at Chicago（芝加哥丰田技术研究所） 纠错

专题命中 预训练与数据 ：pretraining(abstract)；分类 cs.CL、cs.LG

Deep Space Weather Model: Long-Range Solar Flare Prediction from Multi-Wavelength Images

Shunya Nagashima, Komei Sugiura

机构 * Keio University（Keio大学） 纠错

专题命中 预训练与数据 ：pretraining(abstract)；分类 cs.AI

Comments ICCV 2025

SASST: Leveraging Syntax-Aware Chunking and LLMs for Simultaneous Speech Translation

Zeyu Yang, Lai Wei, Roman Koshkin, Xi Chen, Satoshi Nakamura

机构 * The Chinese University of Hong Kong, Shenzhen（香港中文大学（深圳）） ； Okinawa Institute of Science and Technology（冲绳科学技術研究院） ； Nara Institute of Science and Technology（奈良科学技術研究院） 纠错

专题命中 预训练与数据 ：LLM(abstract)；分类 cs.CL

Deep Neural Networks Can Learn Generalizable Same-Different Visual Relations

Alexa R. Tartaglini, Sheridan Feucht, Michael A. Lepori, Wai Keen Vong, Charles Lovering, Brenden M. Lake, Ellie Pavlick

机构 * New York University（纽约大学） ； Brown University（布朗大学） ； Northeastern University（东北大学） 纠错

专题命中 预训练与数据 ：pretraining(abstract)；分类 cs.AI

A Fuzzy Logic Prompting Framework for Large Language Models in Adaptive and Uncertain Tasks

Vanessa Figueiredo

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；prompting(title,abstract)；LLM(abstract)

Democratizing Diplomacy: A Harness for Evaluating Any Large Language Model on Full-Press Diplomacy

Alexander Duffy, Samuel J Paech, Ishana Shastri, Elizabeth Karpinski, Baptiste Alloui-Cros, Tyler Marques, Matthew Lyle Olson

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Large Language Models for Czech Aspect-Based Sentiment Analysis

Jakub Šmíd, Pavel Přibáň, Pavel Král

机构 * University of West Bohemia in Pilsen Faculty of Applied Sciences, Department of Computer Science（西波希米亚大学应用科学学院计算机科学与工程系） 纠错

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL

Comments Accepted for presentation at the 28th International Conference on Text, Speech and Dialogue (TSD 2025)

MASteer: Multi-Agent Adaptive Steer Strategy for End-to-End LLM Trustworthiness Repair

Changqing Li, Tianlin Li, Xiaohan Zhang, Aishan Liu, Li Pan

专题命中 指令微调 ：LLM(title)；large language model(abstract)；language model(abstract)；SFT(abstract)

Aligning Instruction Tuning with Pre-training

Yiming Liang, Tianyu Zheng, Xinrun Du, Ge Zhang, Jiaheng Liu, Xingwei Qu, Wenqiang Zu, Xingrun Xing, Chujie Zheng, Lei Ma, Guoyin Wang, Zhaoxiang Zhang, Wenhao Huang, Xiang Yue, Jiajun Zhang

机构 * School of Artificial Intelligence, University of Chinese Academy of Sciences（中国科学院大学人工智能学院） ； Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所） ； Peking University（北京大学） 纠错

专题命中 指令微调 ：instruction tuning(title,abstract)；LLM(abstract)；large language model(abstract)；language model(abstract)

AutoAssert 1: A LoRA Fine-Tuned LLM Model for Efficient Automated Assertion Generation

Yi Zhong, Hongchao Liu, Di ZHao

机构 * Institute of Computing Technology（计算技术研究所） ； Chinese Academy of Sciences（中国科学院） ； International College（国际学院） ； Beijing University of Posts and Telecommunications（北京邮电大学） ； University of Chinese Academy of Sciences（中国科学院大学） 纠错

专题命中 指令微调 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI

Comments 16pages,6figures

Gradient Surgery for Safe LLM Fine-Tuning

Biao Yi, Jiahao Li, Baolei Zhang, Lihai Nie, Tong Li, Tiansheng Huang, Zheli Liu

机构 * Nankai University（南开大学） 纠错

专题命中 指令微调 ：LLM(title)；large language model(abstract)；language model(abstract)；foundation model(abstract)

Fed MobiLLM: Efficient Federated LLM Fine-Tuning over Heterogeneous Mobile Devices via Server Assisted Side-Tuning

Xingke Yang, Liang Li, Sicong Li, Liwei Guan, Hao Wang, Xiaoqi Qi, Jiang Liu, Xin Fu, Miao Pan

专题命中 指令微调 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.LG

PAE MobiLLM: Privacy-Aware and Efficient LLM Fine-Tuning on the Mobile Device via Additive Side-Tuning

Xingke Yang, Liang Li, Zhiyi Wan, Sicong Li, Xiaoqi Qi, Jiang Liu, Tomoaki Ohtsuki, Xin Fu, Miao Pan

专题命中 指令微调 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.LG

Can Perplexity Predict Fine-tuning Performance? An Investigation of Tokenization Effects on Sequential Language Models for Nepali

Nishant Luitel, Nirajan Bekoju, Anand Kumar Sah, Subarna Shakya

专题命中 指令微调 ：language model(title,abstract)；pretraining(abstract)；分类 cs.CL、cs.LG

Comments 11 pages

Journal ref Proceedings of the Fourth Workshop on Generation, Evaluation and Metrics (GEM^2), pages 239-248, Vienna, Austria and virtual meeting, Association for Computational Linguistics, 2025

SpectrumFM: Redefining Spectrum Cognition via Foundation Modeling

Chunyu Liu, Hao Zhang, Wei Wu, Fuhui Zhou, Qihui Wu, Derrick Wing Kwan Ng, Chan-Byoung Chae

机构 * Nanjing University of Aeronautics and Astronautics（南京航空航天大学） ； Nanjing University of Posts and Telecommunications（南京邮电大学） ； The University of New South Wales（新南威尔士大学） ； Yonsei University（延世大学） 纠错

专题命中 指令微调 ：foundation model(title,abstract)；分类 cs.AI、cs.LG

Comments This paper has been accepted for presentation at the 2025 IEEE Global Communications Conference (GLOBECOM 2025), Cognitive Radio and AI-Enabled Network Symposium

LLMs can be easily Confused by Instructional Distractions

Yerin Hwang, Yongil Kim, Jahyun Koo, Taegwan Kang, Hyunkyung Bae, Kyomin Jung

机构 * IPAI, Seoul National University（IPAI，首尔国立大学） ； LG AI Research（LG人工智能研究所） ； Dept. of ECE, Seoul National University（电子工程系，首尔国立大学） ； SNU-LG AI Research Center（SNU-LG人工智能研究所） 纠错

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；prompting(abstract)；分类 cs.CL、cs.AI

Comments 8 pages

Journal ref Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 19483-19496, Vienna, Austria, July 2025

WSM: Decay-Free Learning Rate Schedule via Checkpoint Merging for LLM Pre-training

Changxin Tian, Jiapeng Wang, Qian Zhao, Kunlong Chen, Jia Liu, Ziqi Liu, Jiaxin Mao, Wayne Xin Zhao, Zhiqiang Zhang, Jun Zhou

机构 * Ling Team, Ant Group（蚂蚁集团灵团队） ； Gaoling School of Artificial Intelligence, Renmin University of China（中国人民大学高岭人工智能学院） 纠错

专题命中 指令微调 ：LLM(title)；分类 cs.CL、cs.LG

Learning to Align, Aligning to Learn: A Unified Approach for Self-Optimized Alignment

Haowen Wang, Yun Yue, Zhiling Ye, Shuowen Zhang, Lei Fan, Jiaxin Liang, Jiadi Jiang, Cheng Wei, Jingyuan Deng, Xudong Han, Ji Li, Chunxiao Guo, Peng Wei, Jian Wang, Jinjie Gu

专题命中 指令微调 ：language model(abstract)；SFT(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 12 pages, 5 figures, 7 tables

DreamFrame: Enhancing Video Understanding via Automatically Generated QA and Style-Consistent Keyframes

Zhende Song, Chenchen Wang, Jiamu Sheng, Chi Zhang, Shengji Tang, Jiayuan Fan, Tao Chen

机构 * Fudan University（复旦大学） ； Westlake University, Tencent PCG（西湖大学、腾讯PCG） 纠错

专题命中 指令微调 ：LLM(abstract)；language model(abstract)；instruction tuning(abstract)

Comments Accepted by ACMM'MM 2025