语言大模型 / LLM - arXivDaily 专题

2505.02486 2025-05-06 cs.LG cs.AI 86%

SEFE: Superficial and Essential Forgetting Eliminator for Multimodal Continual Instruction Tuning

Jinpeng Chen, Runmin Cong, Yuzhi Zhao, Hongzheng Yang, Guangneng Hu, Horace Ho Shing Ip, Sam Kwong

专题命中指令微调：instruction tuning(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

2504.13629 2025-04-21 cs.CL cs.AI econ.GN q-fin.EC 86%

Divergent LLM Adoption and Heterogeneous Convergence Paths in Research Writing

Cong William Lin, Wu Zhu

机构 * Cornell University SC Johnson College of Business（康奈尔大学SC约翰逊商学院）； NBER（国家经济研究局）； Tsinghua University（清华大学）

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

2504.12185 2025-04-17 cs.CL cs.AI 86%

SALAD: Improving Robustness and Generalization through Contrastive Learning with Structure-Aware and LLM-Driven Augmented Data

Suyoung Bae, Hyojun Kim, YunSeok Choi, Jee-Hyong Lee

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments Accepted to NAACL 2025 main. 15 pages, 4 figures

2410.17875 2025-04-09 cs.CL cs.AI 86%

Understanding Layer Significance in LLM Alignment

Guangyuan Shi, Zexin Lu, Xiaoyu Dong, Wenlong Zhang, Xuanyu Zhang, Yujie Feng, Xiao-Ming Wu

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

2503.23740 2025-04-01 cs.CL cs.AI 86%

LANID: LLM-assisted New Intent Discovery

Lu Fan, Jiashu Pu, Rongsheng Zhang, Xiao-Ming Wu

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments Published in LREC-COLING 2024

2503.19206 2025-03-31 cs.CL cs.AI 86%

Overtrained Language Models Are Harder to Fine-Tune

Jacob Mitchell Springer, Sachin Goyal, Kaiyue Wen, Tanishq Kumar, Xiang Yue, Sadhika Malladi, Graham Neubig, Aditi Raghunathan

专题命中指令微调：language model(title,abstract)；LLM(abstract)；large language model(abstract)；分类 cs.CL、cs.AI

Comments 72 pages, 65 figures, 6 tables

2503.18986 2025-03-26 cs.LG cs.AI 86%

SplitFrozen: Split Learning with Device-side Model Frozen for Fine-Tuning LLM on Heterogeneous Resource-Constrained Devices

Jian Ma, Xinchen Lyu, Jun Jiang, Qimei Cui, Haipeng Yao, Xiaofeng Tao

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

2503.15924 2025-03-21 cs.CL cs.AI 86%

Towards Automatic Continual Learning: A Self-Adaptive Framework for Continual Instruction Tuning

Peiyi Lin, Fukai Zhang, Kai Niu, Hao Fu

专题命中指令微调：instruction tuning(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

2503.13507 2025-03-19 cs.CL cs.AI 86%

NeurIPS 2023 LLM Efficiency Fine-tuning Competition

Mark Saroufim, Yotam Perlitz, Leshem Choshen, Luca Antiga, Greg Bowyer, Christian Puhrsch, Driss Guessous, Supriya Rao, Geeta Chauhan, Ashvini Kumar, Jindal Pawan Kumar, Rajpoot Ankur Parikh, Joe Isaacson, Weiwei Yang

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments 11 pages, 10 figures

2503.05132 2025-03-11 cs.AI cs.CV cs.LG 86%

R1-Zero's "Aha Moment" in Visual Reasoning on a 2B Non-SFT Model

Hengguang Zhou, Xirui Li, Ruochen Wang, Minhao Cheng, Tianyi Zhou, Cho-Jui Hsieh

专题命中指令微调：SFT(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

Comments 10 pages, 6 figures

2502.01600 2025-03-11 cs.LG cs.AI 86%

Reinforcement Learning for Long-Horizon Interactive LLM Agents

Kevin Chen, Marco Cusumano-Towner, Brody Huval, Aleksei Petrenko, Jackson Hamburger, Vladlen Koltun, Philipp Krähenbühl

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

2503.05620 2025-03-10 cs.CL cs.AI 86%

Learning LLM Preference over Intra-Dialogue Pairs: A Framework for Utterance-level Understandings

Xuanqing Liu, Luyang Kong, Wei Niu, Afshin Khashei, Belinda Zeng, Steve Johnson, Jon Jay, Davor Golac, Matt Pope

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments 7 pages, 4 figures

2503.02365 2025-03-07 cs.AI cs.CL 86%

EchoQA: A Large Collection of Instruction Tuning Data for Echocardiogram Reports

Lama Moukheiber, Mira Moukheiber, Dana Moukheiiber, Jae-Woo Ju, Hyung-Chul Lee

专题命中指令微调：instruction tuning(title)；LLM(abstract)；large language model(abstract)；language model(abstract)

Comments NeurIPS SafeGenAI 2024

2503.01836 2025-03-04 cs.CL cs.AI 86%

CrowdSelect: Synthetic Instruction Data Selection with Multi-LLM Wisdom

Yisen Li, Lingfeng Yang, Wenxuan Shen, Pan Zhou, Yao Wan, Weiwei Lin, Dongping Chen

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

2502.19557 2025-02-28 cs.CL cs.AI 86%

Distill Not Only Data but Also Rewards: Can Smaller Language Models Surpass Larger Ones?

Yudi Zhang, Lu Wang, Meng Fang, Yali Du, Chenghua Huang, Jun Wang, Qingwei Lin, Mykola Pechenizkiy, Dongmei Zhang, Saravan Rajmohan, Qi Zhang

专题命中指令微调：language model(title,abstract)；large language model(abstract)；SFT(abstract)；分类 cs.CL、cs.AI

Comments 14 pages, 7 figures

2411.07133 2025-02-27 cs.AI cs.CL 86%

Stronger Models are NOT Stronger Teachers for Instruction Tuning

Zhangchen Xu, Fengqing Jiang, Luyao Niu, Bill Yuchen Lin, Radha Poovendran

专题命中指令微调：instruction tuning(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments This is paper is accepted at NAACL 2025

2502.14834 2025-02-21 cs.CV cs.AI cs.CL 86%

LongWriter-V: Enabling Ultra-Long and High-Fidelity Generation in Vision-Language Models

Shangqing Tu, Yucheng Wang, Daniel Zhang-Li, Yushi Bai, Jifan Yu, Yuhao Wu, Lei Hou, Huiqin Liu, Zhiyuan Liu, Bin Xu, Juanzi Li

专题命中指令微调：language model(title,abstract)；SFT(abstract)；preference optimization(abstract)；分类 cs.CL、cs.AI

2412.12499 2025-02-18 cs.CL cs.AI 86%

LinguaLIFT: An Effective Two-stage Instruction Tuning Framework for Low-Resource Language Reasoning

Hongbin Zhang, Kehai Chen, Xuefeng Bai, Yang Xiang, Min Zhang

专题命中指令微调：instruction tuning(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

2410.04064 2025-02-18 cs.LG cs.AI 86%

Text2Chart31: Instruction Tuning for Chart Generation with Automatic Feedback

Fatemeh Pesaran Zadeh, Juyeon Kim, Jin-Hwa Kim, Gunhee Kim

专题命中指令微调：instruction tuning(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

Comments EMNLP 2024 Main Oral. Code and dataset are released at https://github.com/fatemehpesaran310/Text2Chart31

2412.15151 2025-02-14 cs.CL cs.AI 86%

Language Models as Continuous Self-Evolving Data Engineers

Peidong Wang, Ming Wang, Zhiming Ma, Xiaocui Yang, Shi Feng, Daling Wang, Yifei Zhang, Kaisong Song

专题命中指令微调：language model(title,abstract)；large language model(abstract)；post-training(abstract)；分类 cs.CL、cs.AI

2502.03793 2025-02-11 cs.CL cs.AI 86%

It's All in The [MASK]: Simple Instruction-Tuning Enables BERT-like Masked Language Models As Generative Classifiers

Benjamin Clavié, Nathan Cooper, Benjamin Warner

专题命中指令微调：language model(title,abstract)；large language model(abstract)；prompting(abstract)；分类 cs.CL、cs.AI

2501.11877 2025-01-22 cs.CL cs.AI 86%

From Drafts to Answers: Unlocking LLM Potential via Aggregation Fine-Tuning

Yafu Li, Zhilin Wang, Tingchen Fu, Ganqu Cui, Sen Yang, Yu Cheng

专题命中指令微调：LLM(title)；large language model(abstract)；language model(abstract)；SFT(abstract)

Comments 20 pages; work in progress

2310.02842 2025-01-22 cs.CL cs.AI 86%

Sweeping Heterogeneity with Smart MoPs: Mixture of Prompts for LLM Task Adaptation

Chen Dun, Mirian Hipolito Garcia, Guoqing Zheng, Ahmed Hassan Awadallah, Anastasios Kyrillidis, Robert Sim

专题命中指令微调：LLM(title)；large language model(abstract)；language model(abstract)；instruction tuning(abstract)

2501.07853 2025-01-15 cs.CL cs.AI 86%

Optimizing Language Models for Grammatical Acceptability: A Comparative Study of Fine-Tuning Techniques

Shobhit Ratan, Farley Knight, Ghada Jerfel, Sze Chung Ho

专题命中指令微调：language model(title,abstract)；LLM(abstract)；large language model(abstract)；分类 cs.CL、cs.AI

2501.04315 2025-01-14 cs.LG cs.AI 86%

RoRA: Efficient Fine-Tuning of LLM with Reliability Optimization for Rank Adaptation

Jun Liu, Zhenglun Kong, Peiyan Dong, Changdi Yang, Xuan Shen, Pu Zhao, Hao Tang, Geng Yuan, Wei Niu, Wenbin Zhang, Xue Lin, Dong Huang, Yanzhi Wang

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

Comments 2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

2410.12236 2025-01-14 cs.LG cs.AI 86%

Enhancing LLM Agents for Code Generation with Possibility and Pass-rate Prioritized Experience Replay

Yuyang Chen, Kaiyan Zhao, Yiming Wang, Ming Yang, Jian Zhang, Xiaoguang Niu

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

2404.11932 2025-01-07 cs.CL cs.AI 86%

CrossIn: An Efficient Instruction Tuning Approach for Cross-Lingual Knowledge Alignment

Geyu Lin, Bin Wang, Zhengyuan Liu, Nancy F. Chen

专题命中指令微调：instruction tuning(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments 11 pages

2311.08662 2025-01-03 cs.CL cs.AI cs.IR 86%

Evaluating Concurrent Robustness of Language Models Across Diverse Challenge Sets

Vatsal Gupta, Pranshu Pandya, Tushar Kataria, Vivek Gupta, Dan Roth

专题命中指令微调：language model(title,abstract)；large language model(abstract)；prompting(abstract)；分类 cs.CL、cs.AI

Comments 23 pages, 16 Figure, 10 Tables

2411.00852 2024-12-25 cs.LG cs.AI 86%

EF-LLM: Energy Forecasting LLM with AI-assisted Automation, Enhanced Sparse Prediction, Hallucination Detection

Zihang Qiu, Chaojie Li, Zhongyang Wang, Renyou Xie, Borui Zhang, Huadong Mo, Guo Chen, Zhaoyang Dong

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

2407.11780 2024-12-19 cs.CL cs.AI 86%

SwitchCIT: Switching for Continual Instruction Tuning

Xinbo Wu, Max Hartman, Vidhata Arjun Jayaraman, Lav R. Varshney

专题命中指令微调：instruction tuning(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

1. 指令微调 11667 篇

SEFE: Superficial and Essential Forgetting Eliminator for Multimodal Continual Instruction Tuning

Divergent LLM Adoption and Heterogeneous Convergence Paths in Research Writing

SALAD: Improving Robustness and Generalization through Contrastive Learning with Structure-Aware and LLM-Driven Augmented Data

Understanding Layer Significance in LLM Alignment

LANID: LLM-assisted New Intent Discovery

Overtrained Language Models Are Harder to Fine-Tune

SplitFrozen: Split Learning with Device-side Model Frozen for Fine-Tuning LLM on Heterogeneous Resource-Constrained Devices

Towards Automatic Continual Learning: A Self-Adaptive Framework for Continual Instruction Tuning

NeurIPS 2023 LLM Efficiency Fine-tuning Competition

R1-Zero's "Aha Moment" in Visual Reasoning on a 2B Non-SFT Model

Reinforcement Learning for Long-Horizon Interactive LLM Agents

Learning LLM Preference over Intra-Dialogue Pairs: A Framework for Utterance-level Understandings

EchoQA: A Large Collection of Instruction Tuning Data for Echocardiogram Reports

CrowdSelect: Synthetic Instruction Data Selection with Multi-LLM Wisdom

Distill Not Only Data but Also Rewards: Can Smaller Language Models Surpass Larger Ones?

Stronger Models are NOT Stronger Teachers for Instruction Tuning

LongWriter-V: Enabling Ultra-Long and High-Fidelity Generation in Vision-Language Models

LinguaLIFT: An Effective Two-stage Instruction Tuning Framework for Low-Resource Language Reasoning

Text2Chart31: Instruction Tuning for Chart Generation with Automatic Feedback

Language Models as Continuous Self-Evolving Data Engineers

It's All in The [MASK]: Simple Instruction-Tuning Enables BERT-like Masked Language Models As Generative Classifiers

From Drafts to Answers: Unlocking LLM Potential via Aggregation Fine-Tuning

Sweeping Heterogeneity with Smart MoPs: Mixture of Prompts for LLM Task Adaptation

Optimizing Language Models for Grammatical Acceptability: A Comparative Study of Fine-Tuning Techniques

RoRA: Efficient Fine-Tuning of LLM with Reliability Optimization for Rank Adaptation

Enhancing LLM Agents for Code Generation with Possibility and Pass-rate Prioritized Experience Replay

CrossIn: An Efficient Instruction Tuning Approach for Cross-Lingual Knowledge Alignment

Evaluating Concurrent Robustness of Language Models Across Diverse Challenge Sets

EF-LLM: Energy Forecasting LLM with AI-assisted Automation, Enhanced Sparse Prediction, Hallucination Detection

SwitchCIT: Switching for Continual Instruction Tuning