语言大模型 / LLM

Discrete Prompt Tuning via Recursive Utilization of Black-box Multimodal Large Language Model for Personalized Visual Emotion Recognition

Ryo Takahashi, Naoki Saito, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

机构 * Graduate School of Information Science（信息科学研究生学校） ； Technology, Hokkaido University, Sapporo 060-0814, Japan（技术，北海道大学，札幌060-0814，日本） ； Office of Institutional Research, Hokkaido University, Sapporo 060-0808, Japan（机构研究办公室，北海道大学，札幌060-0808，日本） ； Faculty of Information Science（信息科学学院） 纠错

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

Comments 11 pages, 4 figures

EvidenceMap: Learning Evidence Analysis to Unleash the Power of Small Language Models for Biomedical Question Answering

Chang Zong, Jian Wan, Siliang Tang, Lei Zhang

机构 * Zhejiang University of Science and Technology（浙江理工大学） ； Zhejiang University（浙江大学） 纠错

专题命中 指令微调 ：language model(title,abstract)；small language model(title)；LLM(abstract)；分类 cs.CL、cs.AI

Comments 13 pages, 6 figures

Adaptive Tool Use in Large Language Models with Meta-Cognition Trigger

Wenjun Li, Dexun Li, Kuicai Dong, Cong Zhang, Hao Zhang, Weiwen Liu, Yasheng Wang, Ruiming Tang, Yong Liu

机构 * Huawei Noah’s Ark Lab（华为诺亚实验室） 纠错

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments 25 pages, camera ready version for ACL-2025

Utilizing Large Language Models for Information Extraction from Real Estate Transactions

Yu Zhao, Haoxiang Gao, Jinghan Cao, Shiqi Yang

机构 * Rotman School of Management University of Toronto（罗特曼管理学院 东京大学） ； ECE Department Carnegie Mellon University（电子工程系 卡内基梅隆大学） ； Department of Computer Science San Francisco State University（计算机科学系 旧金山州立大学） ； New York University（纽约大学） 纠错

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

A Multi-Stage Large Language Model Framework for Extracting Suicide-Related Social Determinants of Health

Song Wang, Yishu Wei, Haotian Ma, Max Lovitt, Kelly Deng, Yuan Meng, Zihan Xu, Jingze Zhang, Yunyu Xiao, Ying Ding, Xuhai Xu, Joydeep Ghosh, Yifan Peng

机构 * Cockrell School of Engineering, The University of Texas at Austin（德克萨斯大学奥斯汀分校工程学院） ； Population Health Sciences, Weill Cornell Medicine（韦尔·柯尔医学中心流行病学与卫生科学系） ； School of Information, The University of Texas at Austin（德克萨斯大学奥斯汀分校信息学院） ； Department of Biomedical Informatics, Columbia University（哥伦比亚大学生物医学信息学系） 纠错

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

A Bayesian Hybrid Parameter-Efficient Fine-Tuning Method for Large Language Models

Yidong Chai, Yang Liu, Yonghang Zhou, Jiaheng Xie, Daniel Dajun Zeng

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI、cs.LG

Memorization in Fine-Tuned Large Language Models

Danil Savine

机构 * PSL University（PSL大学） ； PRAIRIE Research Institute（PRAIRIE研究机构） 纠错

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Mind the Gap: Conformative Decoding to Improve Output Diversity of Instruction-Tuned Large Language Models

Max Peeperkorn, Tom Kouwenhoven, Dan Brown, Anna Jordanous

机构 * School of Computing University of Kent（肯特大学计算机学院） ； Leiden Institute of Advanced Computer Science Universiteit Leiden（莱顿先进计算机科学研究所） ； Cheriton School of Computer Science University of Waterloo（滑铁卢大学查里顿计算机科学学院） 纠错

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments 9 pages, 3 figures

Instruct-MusicGen: Unlocking Text-to-Music Editing for Music Language Models via Instruction Tuning

Yixiao Zhang, Yukara Ikemiya, Woosung Choi, Naoki Murata, Marco A. Martínez-Ramírez, Liwei Lin, Gus Xia, Wei-Hsiang Liao, Yuki Mitsufuji, Simon Dixon

专题命中 指令微调 ：language model(title,abstract)；instruction tuning(title)；large language model(abstract)；分类 cs.AI、cs.LG

Comments Accepted at ISMIR 2025 Conference. Code and demo are available at: https://github.com/ldzhangyx/instruct-musicgen

Block Circulant Adapter for Large Language Models

Xinyu Ding, Meiqi Wang, Siyu Liao, Zhongfeng Wang

机构 * Sun Yat-sen University（中山大学） 纠错

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

Comments to appear in Proceedings of the 2025 International Joint Conference on Artificial Intelligence (IJCAI-2025)

LogTinyLLM: Tiny Large Language Models Based Contextual Log Anomaly Detection

Isaiah Thompson Ocansey, Ritwik Bhattacharya, Tanmay Sen

机构 * Department of Mathematical Sciences, University of Texas at El Paso, El Paso, TX, USA SQC \& OR Unit, Indian Statistical Institute, Kolkata, India 纠错

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI、cs.LG

Robust Multimodal Large Language Models Against Modality Conflict

Zongmeng Zhang, Wengang Zhou, Jie Zhao, Houqiang Li

机构 * School of Artificial Intelligence（人工智能学院） ； Data Science, University of Science（数据科学，科学大学） ； Department of Electronic Engineering（电子工程系） ； Information Science, University of Science（信息科学，科学大学） ； Huawei Technologies Co., Ltd.（华为技术有限公司） 纠错

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments ICML 2025

Impact of Fine-Tuning Methods on Memorization in Large Language Models

Jie Hou, Chuxiong Wu, Lannan Luo, Qiang Zeng

机构 * George Mason University（乔治·马歇尔大学） 纠错

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

FZOO: Fast Zeroth-Order Optimizer for Fine-Tuning Large Language Models towards Adam-Scale Speed

Sizhe Dang, Yangyang Guo, Yanjun Zhao, Haishan Ye, Xiaodong Zheng, Guang Dai, Ivor Tsang

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI、cs.LG

Dynamic Adaptive Optimization for Effective Sentiment Analysis Fine-Tuning on Large Language Models

Hongcheng Ding, Xuanze Zhao, Ruiting Deng, Shamsul Nahar Abdullah, Deshinta Arrova Dewi, Zixiao Jiang

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

LoRA-One: One-Step Full Gradient Could Suffice for Fine-Tuning Large Language Models, Provably and Efficiently

Yuanhe Zhang, Fanghui Liu, Yudong Chen

机构 * Department of Statistics, University of Warwick, UK.（威斯敏斯特大学统计学系） ； Department of Computer Science, University of Warwick, UK.（威斯敏斯特大学计算机科学系） ； Centre for Discrete Mathematics and its Applications (DIMAP), University of Warwick, UK.（威斯敏斯特大学离散数学及其应用中心（DIMAP）） 纠错

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI、cs.LG

Comments Accepted by ICML 2025 (Oral)

A Comparative Study of Task Adaptation Techniques of Large Language Models for Identifying Sustainable Development Goals

Andrea Cadeddu, Alessandro Chessa, Vincenzo De Leo, Gianni Fenu, Enrico Motta, Francesco Osborne, Diego Reforgiato Recupero, Angelo Salatino, Luca Secchi

机构 * Linkalab s.r.l.（Linkalab公司） ； Department of Mathematics and Computer Science（数学与计算机科学系） ； University of Cagliari（卡利亚里大学） ； Knowledge Media Institute（知识媒体研究所） ； The Open University（开放大学） 纠错

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments Submitted to IEEE Access

LIFEBench: Evaluating Length Instruction Following in Large Language Models

Wei Zhang, Zhenhong Zhou, Kun Wang, Junfeng Fang, Yuanhe Zhang, Rui Wang, Ge Zhang, Xavier Li, Li Sun, Lingjuan Lyu, Yang Liu, Sen Su

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments 81 pages, 22 tables, 32 figures. Homepage: https://ydyjya.github.io/LIFEBench/

Ferret: Federated Full-Parameter Tuning at Scale for Large Language Models

Yao Shu, Wenyang Hu, See-Kiong Ng, Bryan Kian Hsiang Low, Fei Richard Yu

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI、cs.LG

Comments Published as a conference paper at ICML 2025

Communication-Efficient and Tensorized Federated Fine-Tuning of Large Language Models

Sajjad Ghiasvand, Yifan Yang, Zhiyu Xue, Mahnoosh Alizadeh, Zheng Zhang, Ramtin Pedarsani

机构 * Electrical and Computer Engineering Department, UC Santa Barbara（加州大学圣芭芭拉分校电气与计算机工程系） ； Computer Science Department, UC Santa Barbara（加州大学圣芭芭拉分校计算机科学系） 纠错

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

Contrastive Perplexity for Controlled Generation: An Application in Detoxifying Large Language Models

Tassilo Klein, Moin Nabi

机构 * SAP SE（SAP股份有限公司） 纠错

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted to ACL 2025 (Main Track)

Multi-objective Large Language Model Alignment with Hierarchical Experts

Zhuo Li, Guodong Du, Weiyang Guo, Yigeng Zhou, Xiucheng Li, Wenya Wang, Fangming Liu, Yequan Wang, Deheng Ye, Min Zhang, Jing Li

机构 * Harbin Institute of Technology, Shenzhen, China（哈尔滨工业大学（深圳）） ； Nanyang Technological University（南洋理工大学） ； Peng Cheng Laboratory（鹏城实验室） ； Beijing Academy of Artificial Intelligence（北京人工智能研究院） ； Tencent（腾讯） 纠错

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

A Graph Perspective to Probe Structural Patterns of Knowledge in Large Language Models

Utkarsh Sahu, Zhisheng Qi, Yongjia Lei, Ryan A. Rossi, Franck Dernoncourt, Nesreen K. Ahmed, Mahantesh M Halappanavar, Yao Ma, Yu Wang

机构 * University of Oregon（俄勒冈大学） ； Adobe Research（Adobe研究） ； Cisco AI Research（思科人工智能研究） ； Pacific Northwest National Laboratory（太平洋西北国家实验室） ； Rensselaer Polytechnic Institute（拉特格斯理工学院） 纠错

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.LG

T-REX: Mixture-of-Rank-One-Experts with Semantic-aware Intuition for Multi-task Large Language Model Finetuning

Rongyu Zhang, Yijiang Liu, Huanrui Yang, Shenli Zheng, Dan Wang, Yuan Du, Li Du, Shanghang Zhang

机构 * Nanjing University（南京大学） ； PolyU ； Peking University（北京大学） ； University of Arizona（亚利桑那大学） ； Ant Group（蚂蚁集团） 纠错

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.AI、cs.LG

Comments 18 pages, 4 figures

Language-Agnostic Suicidal Risk Detection Using Large Language Models

June-Woo Kim, Wonkyo Oh, Haram Yoon, Sung-Hoon Yoon, Dae-Jin Kim, Dong-Ho Lee, Sang-Yeol Lee, Chan-Mo Yang

机构 * Wonkwang University HospitalRepublic of Korea（Wonkwang大学医院） ； MODULABSRepublic of Korea（MODULABS） ； Wonkwang UniversityRepublic of Korea（Wonkwang大学） ； Department of Psychiatry RSC LAB（精神病学系RSC实验室） ； Department of Psychiatry, School of Medicine（精神病学系，医学院） 纠错

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted to InterSpeech 2025

An Initial Exploration of Fine-tuning Small Language Models for Smart Contract Reentrancy Vulnerability Detection

Ignacio Mariano Andreozzi Pofcher, Joshua Ellul

专题命中 指令微调 ：language model(title,abstract)；small language model(title)；large language model(abstract)；分类 cs.AI、cs.LG

Reinforcement Fine-Tuning Powers Reasoning Capability of Multimodal Large Language Models

Haoyuan Sun, Jiaqi Wu, Bo Xia, Yifu Luo, Yifei Zhao, Kai Qin, Xufei Lv, Tiantian Zhang, Yongzhe Chang, Xueqian Wang

机构 * Tsinghua Shenzhen International Graduate School, Tsinghua University（清华大学深圳国际研究生院，清华大学） 纠错

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Aligning Large Language Models to Follow Instructions and Hallucinate Less via Effective Data Filtering

Shuzheng Si, Haozhe Zhao, Gang Chen, Cheng Gao, Yuzhuo Bai, Zhitong Wang, Kaikai An, Kangyang Luo, Chen Qian, Fanchao Qi, Baobao Chang, Maosong Sun

机构 * Tsinghua University（清华大学） ； Peking University（北京大学） ； DeepLang AI 纠错

专题命中 指令微调 ：large language model(title)；language model(title)；LLM(abstract)；instruction tuning(abstract)

Comments ACL 2025

Neural Incompatibility: The Unbridgeable Gap of Cross-Scale Parametric Knowledge Transfer in Large Language Models

Yuqiao Tan, Shizhu He, Kang Liu, Jun Zhao

机构 * The Key Laboratory of Cognition and Decision Intelligence for Complex Systems, Institute of Automation, Chinese Academy of Sciences（认知与决策智能复杂系统重点实验室，自动化研究所，中国科学院） ； School of Artificial Intelligence, University of Chinese Academy of Sciences（人工智能学院，中国科学院大学） 纠错

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted by ACL'25 Main. Code link: https://github.com/Trae1ounG/Neural_Incompatibility

Clickbait Detection via Large Language Models

Han Wang, Yi Zhu, Ye Wang, Yun Li, Yunhao Yuan, Jipeng Qiang

机构 * School of Information Engineering, Yangzhou University（扬州大学信息工程学院） 纠错

专题命中 指令微调 ：large language model(title,abstract)；language model(title,abstract)；分类 cs.CL、cs.AI

Comments 10 pages, 4 figures