语言大模型 / LLM - arXivDaily 专题

2502.05638 2025-07-09 cs.CL cs.AI 90%

ELMTEX: Fine-Tuning Large Language Models for Structured Clinical Information Extraction. A Case Study on Clinical Reports

Aynur Guluzade, Naguib Heiba, Zeyd Boukhers, Florim Hamiti, Jahid Hasan Polash, Yehya Mohamad, Carlos A Velasco

机构 * Fraunhofer Institute for Applied Information Technology（弗劳恩霍夫应用信息科技研究所）

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL、cs.AI

2507.05065 2025-07-08 cs.LG cs.AI 90%

Replacing thinking with tool usage enables reasoning in small language models

Corrado Rainone, Tim Bakker, Roland Memisevic

机构 * Qualcomm AI Research（高通人工智能研究）

专题命中指令微调：language model(title,abstract)；small language model(title)；large language model(abstract)；SFT(abstract)

Comments 23 pages, includes appendix

2408.14774 2025-07-08 cs.LG cs.CL 90%

Instruct-SkillMix: A Powerful Pipeline for LLM Instruction Tuning

Simran Kaur, Simon Park, Anirudh Goyal, Sanjeev Arora

专题命中指令微调：LLM(title,abstract)；instruction tuning(title)；SFT(abstract)；prompting(abstract)

Journal ref International Conference on Learning Representations (ICLR 2025)

2505.11010 2025-07-08 cs.CL cs.AI 90%

ReviewInstruct: A Review-Driven Multi-Turn Conversations Generation Method for Large Language Models

Jiangxu Wu, Cong Wang, TianHuang Su, Jun Yang, Haozhi Lin, Chao Zhang, Ming Peng, Kai Shi, SongPan Yang, BinQing Pan, ZiXian Li, Ni Yang, ZhenYu Yang

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；SFT(abstract)；分类 cs.CL、cs.AI

Comments ACL2025 Accepted

2506.12576 2025-07-01 cs.CL cs.AI 90%

Enabling Precise Topic Alignment in Large Language Models Via Sparse Autoencoders

Ananya Joshi, Celia Cintas, Skyler Speakman

机构 * Carnegie Mellon University（卡内基梅隆大学）； IBM Research（IBM研究院）

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2506.09428 2025-07-01 cs.CL cs.AI 90%

Improved Supervised Fine-Tuning for Large Language Models to Mitigate Catastrophic Forgetting

Fei Ding, Baiqiao Wang

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；SFT(abstract)；分类 cs.CL、cs.AI

2506.06406 2025-06-26 cs.CL cs.AI 90%

SMAR: Soft Modality-Aware Routing Strategy for MoE-based Multimodal Large Language Models Preserving Language Capabilities

Guoyang Xia, Yifeng Ding, Fengfa Li, Lei Ren, Wei Chen, Fangxiang Feng, Xiaojie Wang

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；instruction tuning(abstract)；分类 cs.CL、cs.AI

2506.07245 2025-06-23 cs.CL cs.AI 90%

SDE-SQL: Enhancing Text-to-SQL Generation in Large Language Models via Self-Driven Exploration with SQL Probes

Wenxuan Xie, Yaxun Dai, Wenhao Jiang

机构 * South China University of Technology（华南理工大学）； Soochow University（苏州大学）； Guangdong Laboratory of AI and Digital Economy（广东人工智能与数字经济实验室）

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；SFT(abstract)；分类 cs.CL、cs.AI

2506.15629 2025-06-19 cs.CL cs.AI 90%

Revisiting Compositional Generalization Capability of Large Language Models Considering Instruction Following Ability

Yusuke Sakai, Hidetaka Kamigaito, Taro Watanabe

机构 * Nara Institute of Science and Technology（奈良科学技術大學）

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments ACL 2025 Main

2506.12483 2025-06-17 cs.AI cs.CL 90%

MALM: A Multi-Information Adapter for Large Language Models to Mitigate Hallucination

Ao Jia, Haiming Wu, Guohui Yao, Dawei Song, Songkun Ji, Yazhou Zhang

机构 * Beijing Institute of Technology（北京理工大学）； The Open University（开放大学）； Beijing Information Science and Technology University（北京信息科技大学）； The Hong Kong Polytechnic University（香港理工大学）

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2506.11109 2025-06-16 cs.CL cs.AI 90%

Enhancing Large Language Models for Mobility Analytics with Semantic Location Tokenization

Yile Chen, Yicheng Tao, Yue Jiang, Shuai Liu, Han Yu, Gao Cong

机构 * Nanyang Technological University（南洋理工大学）； Southern University of Science and Technology（南方科技大学）

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Accepted by KDD'25

2402.13459 2025-05-30 cs.LG cs.CL cs.CR 90%

Learning to Poison Large Language Models for Downstream Manipulation

Xiangyu Zhou, Yao Qiang, Saleh Zare Zade, Mohammad Amin Roshani, Prashant Khanduri, Douglas Zytko, Dongxiao Zhu

机构 * Department of Computer Science, Wayne State University（韦恩州立大学计算机科学系）； Computer Science and Engineering Department, Oakland University（奥克兰大学计算机科学与工程系）； College of Innovation and Technology, University of Michigan-Flint（密歇根大学弗林特分校创新与技术学院）

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；SFT(abstract)；分类 cs.CL、cs.LG

2504.12898 2025-05-28 cs.CL cs.AI 90%

Information Gain-Guided Causal Intervention for Autonomous Debiasing Large Language Models

Zhouhao Sun, Xiao Ding, Li Du, Yunpeng Xu, Yixuan Ma, Yang Zhao, Bing Qin, Ting Liu

机构 * Research Center for Social Computing and Interactive Robotics（社会计算与交互机器人研究中心）； Harbin Institute of Technology（哈尔滨工业大学）； Beijing Academy of Artificial Intelligence（北京人工智能研究院）

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2505.18464 2025-05-27 cs.HC cs.AI cs.CL cs.CY 90%

From Reddit to Generative AI: Evaluating Large Language Models for Anxiety Support Fine-tuned on Social Media Data

Ugur Kursuncu, Trilok Padhi, Gaurav Sinha, Abdulkadir Erol, Jaya Krishna Mandivarapu, Christopher R. Larrison

机构 * Georgia State University（佐治亚州立大学）； University of Georgia（佐治亚大学）； Microsoft（微软）； University of Illinois at Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL、cs.AI

2407.21077 2025-05-26 cs.CL cs.LG cs.NE 90%

Genetic Instruct: Scaling up Synthetic Generation of Coding Instructions for Large Language Models

Somshubra Majumdar, Vahid Noroozi, Mehrzad Samadi, Sean Narenthiran, Aleksander Ficek, Wasi Uddin Ahmad, Jocelyn Huang, Jagadeesh Balam, Boris Ginsburg

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments Accepted to be presented in ACL 2025

2505.16944 2025-05-23 cs.AI cs.CL 90%

AGENTIF: Benchmarking Instruction Following of Large Language Models in Agentic Scenarios

Yunjia Qi, Hao Peng, Xiaozhi Wang, Amy Xin, Youfeng Liu, Bin Xu, Lei Hou, Juanzi Li

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2505.15475 2025-05-22 cs.CL cs.AI 90%

LFTF: Locating First and Then Fine-Tuning for Mitigating Gender Bias in Large Language Models

Zhanyue Qin, Yue Ding, Deyuan Liu, Qingbin Liu, Junxian Cai, Xi Chen, Zhiying Tu, Dianhui Chu, Cuiyun Gao, Dianbo Sui

机构 * Harbin Institute of Technology（哈尔滨工业大学）； Tencent（腾讯）

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2505.11615 2025-05-20 cs.CL cs.AI 90%

Steering Risk Preferences in Large Language Models by Aligning Behavioral and Neural Representations

Jian-Qiao Zhu, Haijiang Yan, Thomas L. Griffiths

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2406.10785 2025-05-20 cs.CL cs.AI 90%

ShareLoRA: Parameter Efficient and Robust Large Language Model Fine-tuning via Shared Low-Rank Adaptation

Yurun Song, Junchen Zhao, Ian G. Harris, Sangeetha Abdu Jyothi

机构 * UC Irvine（uci大学）； VMware Research（vmware研究院）

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments 17 pages, 7 figures

2406.17692 2025-05-13 cs.CL cs.LG 90%

From Distributional to Overton Pluralism: Investigating Large Language Model Alignment

Thom Lake, Eunsol Choi, Greg Durrett

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments NAACL 2025 (Main Conference)

2412.08587 2025-05-13 cs.CL cs.AI 90%

Advancing Single and Multi-task Text Classification through Large Language Model Fine-tuning

Hang Zhao, Qile P. Chen, Yijing Barry Zhang, Gang Yang

机构 * Meta Platforms, Inc.（Meta平台公司）； Anthropic PBC（Anthropic公司）

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments 9 pages, 3 tables

2505.05616 2025-05-12 cs.AI cs.LG q-bio.BM 90%

Leveraging Large Language Models for enzymatic reaction prediction and characterization

Lorenzo Di Fruscia, Jana Marie Weber

机构 * Delft University of Technology（代尔夫特理工大学）

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

2505.02795 2025-05-06 cs.LG cs.AI cs.DC 90%

HSplitLoRA: A Heterogeneous Split Parameter-Efficient Fine-Tuning Framework for Large Language Models

Zheng Lin, Yuxin Zhang, Zhe Chen, Zihan Fang, Xianhao Chen, Praneeth Vepakomma, Wei Ni, Jun Luo, Yue Gao

机构 * Institute of Space Internet, Fudan University（复旦大学空间互联网研究所）； School of Computer Science, Fudan University（复旦大学计算机科学学院）； Department of Electrical and Electronic Engineering, University of Hong Kong（香港大学电子与电气工程系）； Mohamed bin Zayed University of Artificial Intelligence（莫扎伊德人工智能大学）； Massachusetts Institute of Technology（麻省理工学院）； Data61, CSIRO（CSIRO Data61）； School of Computer Engineering, Nanyang Technological University（南洋理工大学计算机工程学院）

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

Comments 16 pages, 22 figures

2410.24175 2025-04-30 cs.CL cs.AI 90%

Constraint Back-translation Improves Complex Instruction Following of Large Language Models

Yunjia Qi, Hao Peng, Xiaozhi Wang, Bin Xu, Lei Hou, Juanzi Li

机构 * Department of Computer Science and Technology, BNRist, Tsinghua University（计算机科学与技术系，BNRist，清华大学）

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；post-training(abstract)；分类 cs.CL、cs.AI

Comments 14 pages, 6 figures

2504.05411 2025-04-09 cs.CL cs.LG 90%

Less but Better: Parameter-Efficient Fine-Tuning of Large Language Models for Personality Detection

Lingzhi Shen, Yunfei Long, Xiaohao Cai, Guanming Chen, Imran Razzak, Shoaib Jameel

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

2408.16673 2025-04-08 cs.LG cs.AI 90%

Preserving Diversity in Supervised Fine-Tuning of Large Language Models

Ziniu Li, Congliang Chen, Tian Xu, Zeyu Qin, Jiancong Xiao, Zhi-Quan Luo, Ruoyu Sun

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；SFT(abstract)；分类 cs.AI、cs.LG

Comments accepted by ICLR 2025

2409.08596 2025-04-03 cs.CL cs.AI cs.SD eess.AS 90%

Large Language Model Can Transcribe Speech in Multi-Talker Scenarios with Versatile Instructions

Lingwei Meng, Shujie Hu, Jiawen Kang, Zhaoqing Li, Yuejiao Wang, Wenxuan Wu, Xixin Wu, Xunying Liu, Helen Meng

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Accepted to IEEE ICASSP 2025. Update code link

2503.17932 2025-03-25 cs.CL cs.AI cs.CR 90%

STShield: Single-Token Sentinel for Real-Time Jailbreak Detection in Large Language Models

Xunguang Wang, Wenxuan Wang, Zhenlan Ji, Zongjie Li, Pingchuan Ma, Daoyuan Wu, Shuai Wang

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments 11 pages

2410.16801 2025-03-24 cs.CL cs.AI 90%

Controlled Low-Rank Adaptation with Subspace Regularization for Continued Training on Large Language Models

Yuheng Lu, Bingshuo Qian, Caixia Yuan, Huixing Jiang, Xiaojie Wang

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2503.08681 2025-03-12 cs.CL cs.LG 90%

Self-Taught Self-Correction for Small Language Models

Viktor Moskvoretskii, Chris Biemann, Irina Nikishina

专题命中指令微调：language model(title,abstract)；small language model(title,abstract)；large language model(abstract)；分类 cs.CL、cs.LG

Comments Code is available at https://github.com/VityaVitalich/STASC

1. 指令微调 11654 篇

ELMTEX: Fine-Tuning Large Language Models for Structured Clinical Information Extraction. A Case Study on Clinical Reports

Replacing thinking with tool usage enables reasoning in small language models

Instruct-SkillMix: A Powerful Pipeline for LLM Instruction Tuning

ReviewInstruct: A Review-Driven Multi-Turn Conversations Generation Method for Large Language Models

Enabling Precise Topic Alignment in Large Language Models Via Sparse Autoencoders

Improved Supervised Fine-Tuning for Large Language Models to Mitigate Catastrophic Forgetting

SMAR: Soft Modality-Aware Routing Strategy for MoE-based Multimodal Large Language Models Preserving Language Capabilities

SDE-SQL: Enhancing Text-to-SQL Generation in Large Language Models via Self-Driven Exploration with SQL Probes

Revisiting Compositional Generalization Capability of Large Language Models Considering Instruction Following Ability

MALM: A Multi-Information Adapter for Large Language Models to Mitigate Hallucination

Enhancing Large Language Models for Mobility Analytics with Semantic Location Tokenization

Learning to Poison Large Language Models for Downstream Manipulation

Information Gain-Guided Causal Intervention for Autonomous Debiasing Large Language Models

From Reddit to Generative AI: Evaluating Large Language Models for Anxiety Support Fine-tuned on Social Media Data

Genetic Instruct: Scaling up Synthetic Generation of Coding Instructions for Large Language Models

AGENTIF: Benchmarking Instruction Following of Large Language Models in Agentic Scenarios

LFTF: Locating First and Then Fine-Tuning for Mitigating Gender Bias in Large Language Models

Steering Risk Preferences in Large Language Models by Aligning Behavioral and Neural Representations

ShareLoRA: Parameter Efficient and Robust Large Language Model Fine-tuning via Shared Low-Rank Adaptation

From Distributional to Overton Pluralism: Investigating Large Language Model Alignment

Advancing Single and Multi-task Text Classification through Large Language Model Fine-tuning

Leveraging Large Language Models for enzymatic reaction prediction and characterization

HSplitLoRA: A Heterogeneous Split Parameter-Efficient Fine-Tuning Framework for Large Language Models

Constraint Back-translation Improves Complex Instruction Following of Large Language Models

Less but Better: Parameter-Efficient Fine-Tuning of Large Language Models for Personality Detection

Preserving Diversity in Supervised Fine-Tuning of Large Language Models

Large Language Model Can Transcribe Speech in Multi-Talker Scenarios with Versatile Instructions

STShield: Single-Token Sentinel for Real-Time Jailbreak Detection in Large Language Models

Controlled Low-Rank Adaptation with Subspace Regularization for Continued Training on Large Language Models

Self-Taught Self-Correction for Small Language Models