语言大模型 / LLM - arXivDaily 专题

2505.16107 2025-05-23 cs.CL 89%

MPL: Multiple Programming Languages with Large Language Models for Information Extraction

Bo Li, Gexiang Fang, Wei Ye, Zhenghua Xu, Jinglei Zhang, Hao Cheng, Shikun Zhang

机构 * State Key Laboratory of Intelligent Power Distribution Equipment and System（智能电力设备与系统国家重点实验室）； School of Health Sciences and Biomedical Engineering（健康科学与生物医学工程学院）； National Engineering Research Center for Software Engineering（软件工程国家工程研究中心）； Peking University（北京大学）； School of Artificial Intelligence（人工智能学院）

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；SFT(abstract)；分类 cs.CL

Comments Findings of ACL2025

2505.03469 2025-05-22 cs.CL 89%

Long-Short Chain-of-Thought Mixture Supervised Fine-Tuning Eliciting Efficient Reasoning in Large Language Models

Bin Yu, Hang Yuan, Haotian Li, Xueyin Xu, Yuliang Wei, Bailing Wang, Weizhen Qi, Kai Chen

机构 * First Author Affiliation（第一作者单位）； Second Author Affiliation（第二作者单位）

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；SFT(abstract)；分类 cs.CL

Comments 12 pages, 5 figures

2410.07074 2025-05-09 cs.LG 89%

Let's Ask GNN: Empowering Large Language Model for Graph In-Context Learning

Zhengyu Hu, Yichuan Li, Zhengyu Chen, Jingang Wang, Han Liu, Kyumin Lee, Kaize Ding

机构 * Northwestern University（西北大学）； Worcester Polytechnic Institute（沃思堡理工大学）； MeiTuan（美团）

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

2505.04196 2025-05-08 cs.LG cs.MA 89%

A Large Language Model for Feasible and Diverse Population Synthesis

Sung Yoo Lim, Hyunsoo Yun, Prateek Bansal, Dong-Kyu Kim, Eui-Jin Kim

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Comments 28 pages, 7 figures, 6 tables. Submitted to Transportation Research Part C: Emerging Technologies. Preprint version

2504.21330 2025-05-01 cs.CL 89%

Does the Prompt-based Large Language Model Recognize Students' Demographics and Introduce Bias in Essay Scoring?

Kaixun Yang, Mladen Raković, Dragan Gašević, Guanliang Chen

机构 * Centre for Learning Analytics, Monash University（学习分析中心，莫纳什大学）

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2502.11258 2025-05-01 cs.CL 89%

Leveraging Conditional Mutual Information to Improve Large Language Model Fine-Tuning For Classification

Thanushon Sivakaran, En-Hui Yang

机构 * Department of Electrical and Computer Engineering University of Waterloo（电气与计算机工程系华威大学）

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 6 pages, 2 figures, Published to IEEE ISIT 2025

Journal ref 2025 IEEE International Symposium on Information Theory (ISIT 2025)

2504.16120 2025-04-24 cs.CR cs.AI 89%

A Data-Centric Approach for Safe and Secure Large Language Models against Threatening and Toxic Content

Chaima Njeh, Haïfa Nakouri, Fehmi Jaafar

机构 * Quebec University at Chicoutimi（魁北克大学夏斯库蒂米分校）

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

Comments This paper is under revision in the International Journal of Information Security

2502.10482 2025-04-18 cs.AI 89%

A Self-Supervised Reinforcement Learning Approach for Fine-Tuning Large Language Models Using Cross-Attention Signals

Andrew Kiruluta, Andreas Lemos, Priscilla Burity

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；RLHF(abstract)；分类 cs.AI

2406.03230 2025-04-04 cs.CR cs.LG 89%

Defending Large Language Models Against Attacks With Residual Stream Activation Analysis

Amelia Kawasaki, Andrew Davis, Houssam Abbas

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Comments Included in Proceedings of the Conference on Applied Machine Learning in Information Security (CAMLIS 2024), Arlington, Virginia, USA, October 24-25, 2024

2312.15960 2025-04-01 cs.LG cs.PL cs.SE 89%

MoTCoder: Elevating Large Language Models with Modular of Thought for Challenging Programming Tasks

Jingyao Li, Pengguang Chen, Bin Xia, Hong Xu, Jiaya Jia

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；instruction tuning(abstract)；分类 cs.LG

Comments Data: https://huggingface.co/datasets/JingyaoLi/MoTCode-Data,MoTCoder-32B: https://huggingface.co/JingyaoLi/MoTCoder-32B-V1.5,MoTCoder-7B: https://huggingface.co/JingyaoLi/MoTCoder-7B-v1.5,Code: https://github.com/dvlab-research/MoTCoder, Paper: arXiv:2312.15960

2503.18062 2025-03-25 cs.CL 89%

Investigating Recent Large Language Models for Vietnamese Machine Reading Comprehension

Anh Duc Nguyen, Hieu Minh Phi, Anh Viet Ngo, Long Hai Trieu, Thai Phuong Nguyen

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2503.17578 2025-03-25 cs.LG 89%

Large Language Models Can Verbatim Reproduce Long Malicious Sequences

Sharon Lin, Krishnamurthy, Dvijotham, Jamie Hayes, Chongyang Shi, Ilia Shumailov, Shuang Song

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

2502.18008 2025-03-24 cs.SD cs.AI eess.AS 89%

NotaGen: Advancing Musicality in Symbolic Music Generation with Large Language Model Training Paradigms

Yashan Wang, Shangda Wu, Jianhuai Hu, Xingjian Du, Yueqi Peng, Yongxin Huang, Shuai Fan, Xiaobing Li, Feng Yu, Maosong Sun

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2503.16094 2025-03-21 cs.CL 89%

Cultural Alignment in Large Language Models Using Soft Prompt Tuning

Reem I. Masoud, Martin Ferianc, Philip Treleaven, Miguel Rodrigues

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2503.13833 2025-03-19 cond-mat.mtrl-sci cs.LG 89%

Causal Discovery from Data Assisted by Large Language Models

Kamyar Barakati, Alexander Molak, Chris Nelson, Xiaohang Zhang, Ichiro Takeuchi, Sergei V. Kalinin

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Comments 12 pages, 5 figures

2503.03135 2025-03-11 cs.LG 89%

Bridging Molecular Graphs and Large Language Models

Runze Wang, Mingqi Yang, Yanming Shen

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Comments AAAI 2025 camera ready version

2503.04332 2025-03-07 cs.CR cs.LG 89%

The Challenge of Identifying the Origin of Black-Box Large Language Models

Ziqing Yang, Yixin Wu, Yun Shen, Wei Dai, Michael Backes, Yang Zhang

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

2407.10223 2025-03-04 cs.LG cs.CR 89%

On Large Language Model Continual Unlearning

Chongyang Gao, Lixu Wang, Kaize Ding, Chenkai Weng, Xiao Wang, Qi Zhu

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Comments This paper has been accepted by ICLR 2025. The first two authors contribute equally and they are ordered alphabetically

2310.19651 2025-03-04 cs.CL 89%

Dynamics of Instruction Fine-Tuning for Chinese Large Language Models

Chiyu Song, Zhanchao Zhou, Jianhao Yan, Yuejiao Fei, Zhenzhong Lan, Yue Zhang

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；instruction tuning(abstract)；分类 cs.CL

Comments Accepted to COLING 2025

2412.16100 2025-03-03 cs.CL 89%

Logical Consistency of Large Language Models in Fact-checking

Bishwamittra Ghosh, Sarah Hasan, Naheed Anjum Arafat, Arijit Khan

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Published at ICLR 2025

2406.11391 2025-02-25 cs.LG 89%

P-TA: Using Proximal Policy Optimization to Enhance Tabular Data Augmentation via Large Language Models

Shuo Yang, Chenchen Yuan, Yao Rong, Felix Steinbauer, Gjergji Kasneci

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

2404.10306 2025-02-25 cs.CL 89%

Balancing Speciality and Versatility: A Coarse to Fine Framework for Mitigating Catastrophic Forgetting in Large Language Models

Hengyuan Zhang, Yanru Wu, Dawei Li, Sak Yang, Rui Zhao, Yong Jiang, Fei Tan

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；SFT(abstract)；分类 cs.CL

Comments 43 pages, 10 figures, accepted by ACL 2024

2502.14482 2025-02-21 cs.CL 89%

NLoRA: Nyström-Initiated Low-Rank Adaptation for Large Language Models

Chenlu Guo, Yuan Wu, Yi Chang

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2502.08130 2025-02-21 cs.CL 89%

Selective Self-to-Supervised Fine-Tuning for Generalization in Large Language Models

Sonam Gupta, Yatin Nandwani, Asaf Yehudai, Dinesh Khandelwal, Dinesh Raghu, Sachindra Joshi

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；SFT(abstract)；分类 cs.CL

Comments 10 pages, Accepted to NAACL Findings 2025. arXiv admin note: text overlap with arXiv:2409.04787

2404.08680 2025-02-21 cs.CL cs.DL cs.IR 89%

Automating Research Synthesis with Domain-Specific Large Language Model Fine-Tuning

Teo Susnjak, Peter Hwang, Napoleon H. Reyes, Andre L. C. Barczak, Timothy R. McIntosh, Surangika Ranathunga

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2501.18005 2025-02-12 cs.SE cs.LG 89%

Fault Localization via Fine-tuning Large Language Models with Mutation Generated Stack Traces

Neetha Jambigi, Bartosz Bogacz, Moritz Mueller, Thomas Bach, Michael Felderer

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.LG

Comments I do not have the necessary approvals to out the paper on Arxiv from my organization yet. I was too soon to do this

2410.11235 2025-02-12 cs.CL 89%

GT2Vec: Large Language Models as Multi-Modal Encoders for Text and Graph-Structured Data

Jiacheng Lin, Kun Qian, Haoyu Han, Nurendra Choudhary, Tianxin Wei, Zhongruo Wang, Sahika Genc, Edward W Huang, Sheng Wang, Karthik Subbian, Danai Koutra, Jimeng Sun

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2409.01658 2025-02-06 cs.CL 89%

From Yes-Men to Truth-Tellers: Addressing Sycophancy in Large Language Models with Pinpoint Tuning

Wei Chen, Zhen Huang, Liang Xie, Binbin Lin, Houqiang Li, Le Lu, Xinmei Tian, Deng Cai, Yonggang Zhang, Wenxiao Wang, Xu Shen, Jieping Ye

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；SFT(abstract)；分类 cs.CL

Comments accepted by ICML 2024, code and data are available at https://github.com/yellowtownhz/sycophancy-interpretability

2501.15571 2025-01-28 cs.CL 89%

Cross-Cultural Fashion Design via Interactive Large Language Models and Diffusion Models

Spencer Ramsey, Amina Grant, Jeffrey Lee

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2402.09649 2025-01-24 cs.CE cs.AI q-bio.BM 89%

ProtChatGPT: Towards Understanding Proteins with Large Language Models

Chao Wang, Hehe Fan, Ruijie Quan, Yi Yang

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

1. 指令微调 11653 篇

MPL: Multiple Programming Languages with Large Language Models for Information Extraction

Long-Short Chain-of-Thought Mixture Supervised Fine-Tuning Eliciting Efficient Reasoning in Large Language Models

Let's Ask GNN: Empowering Large Language Model for Graph In-Context Learning

A Large Language Model for Feasible and Diverse Population Synthesis

Does the Prompt-based Large Language Model Recognize Students' Demographics and Introduce Bias in Essay Scoring?

Leveraging Conditional Mutual Information to Improve Large Language Model Fine-Tuning For Classification

A Data-Centric Approach for Safe and Secure Large Language Models against Threatening and Toxic Content

A Self-Supervised Reinforcement Learning Approach for Fine-Tuning Large Language Models Using Cross-Attention Signals

Defending Large Language Models Against Attacks With Residual Stream Activation Analysis

MoTCoder: Elevating Large Language Models with Modular of Thought for Challenging Programming Tasks

Investigating Recent Large Language Models for Vietnamese Machine Reading Comprehension

Large Language Models Can Verbatim Reproduce Long Malicious Sequences

NotaGen: Advancing Musicality in Symbolic Music Generation with Large Language Model Training Paradigms

Cultural Alignment in Large Language Models Using Soft Prompt Tuning

Causal Discovery from Data Assisted by Large Language Models

Bridging Molecular Graphs and Large Language Models

The Challenge of Identifying the Origin of Black-Box Large Language Models

On Large Language Model Continual Unlearning

Dynamics of Instruction Fine-Tuning for Chinese Large Language Models

Logical Consistency of Large Language Models in Fact-checking

P-TA: Using Proximal Policy Optimization to Enhance Tabular Data Augmentation via Large Language Models

Balancing Speciality and Versatility: A Coarse to Fine Framework for Mitigating Catastrophic Forgetting in Large Language Models

NLoRA: Nyström-Initiated Low-Rank Adaptation for Large Language Models

Selective Self-to-Supervised Fine-Tuning for Generalization in Large Language Models

Automating Research Synthesis with Domain-Specific Large Language Model Fine-Tuning

Fault Localization via Fine-tuning Large Language Models with Mutation Generated Stack Traces

GT2Vec: Large Language Models as Multi-Modal Encoders for Text and Graph-Structured Data

From Yes-Men to Truth-Tellers: Addressing Sycophancy in Large Language Models with Pinpoint Tuning

Cross-Cultural Fashion Design via Interactive Large Language Models and Diffusion Models

ProtChatGPT: Towards Understanding Proteins with Large Language Models