语言大模型 / LLM - arXivDaily 专题

2409.20566 2024-10-01 cs.CV cs.CL cs.LG 84%

MM1.5: Methods, Analysis & Insights from Multimodal LLM Fine-tuning

Haotian Zhang, Mingfei Gao, Zhe Gan, Philipp Dufter, Nina Wenzel, Forrest Huang, Dhruti Shah, Xianzhi Du, Bowen Zhang, Yanghao Li, Sam Dodge, Keen You, Zhen Yang, Aleksei Timofeev, Mingze Xu, Hong-You Chen, Jean-Philippe Fauconnier, Zhengfeng Lai, Haoxuan You, Zirui Wang, Afshin Dehghan, Peter Grasch, Yinfei Yang

专题命中指令微调：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.LG

2408.17354 2024-09-02 cs.LG cs.AI cs.CR 84%

Forget to Flourish: Leveraging Machine-Unlearning on Pretrained Language Models for Privacy Leakage

Md Rafi Ur Rashid, Jing Liu, Toshiaki Koike-Akino, Shagufta Mehnaz, Ye Wang

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.AI、cs.LG

2408.04816 2024-08-12 cs.CL cs.LG 84%

FUSE-ing Language Models: Zero-Shot Adapter Discovery for Prompt Optimization Across Tokenizers

Joshua Nathaniel Williams, J. Zico Kolter

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.CL、cs.LG

Comments Published as a Conference Paper at COLM 2024; 10 Pages; https://github.com/jnwilliams/FUSE_prompt_inversion.git

2404.10859 2024-08-09 cs.CL cs.LG 84%

Forcing Diffuse Distributions out of Language Models

Yiming Zhang, Avi Schwarzschild, Nicholas Carlini, Zico Kolter, Daphne Ippolito

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.CL、cs.LG

2402.09497 2024-07-15 cs.CR cs.AI cs.LG cs.SE 84%

Instruction Tuning for Secure Code Generation

Jingxuan He, Mark Vero, Gabriela Krasnopolska, Martin Vechev

专题命中指令微调：instruction tuning(title,abstract)；language model(abstract)；分类 cs.AI、cs.LG

2310.01691 2024-07-15 cs.CL cs.AI 84%

Zero-Shot Continuous Prompt Transfer: Generalizing Task Semantics Across Language Models

Zijun Wu, Yongkang Wu, Lili Mou

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.CL、cs.AI

Comments Accepted by ICLR 2024

2406.13269 2024-06-21 cs.AI cs.CL cs.HC eess.SP 84%

Investigating Low-Cost LLM Annotation for~Spoken Dialogue Understanding Datasets

Lucas Druart, Valentin Vielzeuf, Yannick Estève

专题命中指令微调：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Journal ref 27th International Conference on Text, Speech and Dialogue, Sep 2024, Brno (R{é}p. Tch{è}que), Czech Republic

2406.04606 2024-06-10 cs.LG cs.AI 84%

Helpful or Harmful Data? Fine-tuning-free Shapley Attribution for Explaining Language Model Predictions

Jingtan Wang, Xiaoqiang Lin, Rui Qiao, Chuan-Sheng Foo, Bryan Kian Hsiang Low

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.AI、cs.LG

Comments Accepted to ICML 2024

2402.12336 2024-06-06 cs.LG cs.AI cs.CV stat.ML 84%

Robust CLIP: Unsupervised Adversarial Fine-Tuning of Vision Embeddings for Robust Large Vision-Language Models

Christian Schlarmann, Naman Deep Singh, Francesco Croce, Matthias Hein

专题命中指令微调：language model(title,abstract)；foundation model(abstract)；分类 cs.AI、cs.LG

Comments ICML 2024 Oral

2405.20495 2024-06-03 cs.CL cs.LG 84%

Transfer Q Star: Principled Decoding for LLM Alignment

Souradip Chakraborty, Soumya Suvra Ghosal, Ming Yin, Dinesh Manocha, Mengdi Wang, Amrit Singh Bedi, Furong Huang

专题命中指令微调：LLM(title)；foundation model(abstract)；SFT(abstract)；分类 cs.CL、cs.LG

2405.12656 2024-05-22 cs.CL cs.AI 84%

Retrieval-Augmented Language Model for Extreme Multi-Label Knowledge Graph Link Prediction

Yu-Hsiang Lin, Huang-Ting Shieh, Chih-Yu Liu, Kuang-Ting Lee, Hsiao-Cheng Chang, Jing-Lun Yang, Yu-Sheng Lin

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.CL、cs.AI

2402.12147 2024-05-01 cs.CL cs.AI 84%

Surprising Efficacy of Fine-Tuned Transformers for Fact-Checking over Larger Language Models

Vinay Setty

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.CL、cs.AI

Comments Accepted in SIGIR 2024 (industry track)

2402.16472 2024-04-18 cs.CL cs.AI 84%

mEdIT: Multilingual Text Editing via Instruction Tuning

Vipul Raheja, Dimitris Alikaniotis, Vivek Kulkarni, Bashar Alhafni, Dhruv Kumar

专题命中指令微调：instruction tuning(title,abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments Accepted to NAACL 2024 (Main). 23 pages, 8 tables, 11 figures

2403.11124 2024-04-02 cs.CL cs.AI 84%

Scaling Data Diversity for Fine-Tuning Language Models in Human Alignment

Feifan Song, Bowen Yu, Hao Lang, Haiyang Yu, Fei Huang, Houfeng Wang, Yongbin Li

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.CL、cs.AI

Comments Accepted by LREC-COLING 2024

2403.10088 2024-03-18 cs.CL cs.AI 84%

Intent-conditioned and Non-toxic Counterspeech Generation using Multi-Task Instruction Tuning with RLAIF

Amey Hengle, Aswini Kumar, Sahajpreet Singh, Anil Bandhakavi, Md Shad Akhtar, Tanmoy Chakroborty

专题命中指令微调：instruction tuning(title,abstract)；language model(abstract)；分类 cs.CL、cs.AI

2211.00635 2024-03-14 cs.CL cs.LG 84%

Two-stage LLM Fine-tuning with Less Specialization and More Generalization

Yihan Wang, Si Si, Daliang Li, Michal Lukasik, Felix Yu, Cho-Jui Hsieh, Inderjit S Dhillon, Sanjiv Kumar

专题命中指令微调：LLM(title)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.LG

Comments ICLR 2024

2402.15833 2024-02-27 cs.CL cs.LG 84%

Prompt Perturbation Consistency Learning for Robust Language Models

Yao Qiang, Subhrangshu Nandi, Ninareh Mehrabi, Greg Ver Steeg, Anoop Kumar, Anna Rumshisky, Aram Galstyan

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.CL、cs.LG

2402.07872 2024-02-13 cs.RO cs.CL cs.CV cs.LG 84%

PIVOT: Iterative Visual Prompting Elicits Actionable Knowledge for VLMs

Soroush Nasiriany, Fei Xia, Wenhao Yu, Ted Xiao, Jacky Liang, Ishita Dasgupta, Annie Xie, Danny Driess, Ayzaan Wahid, Zhuo Xu, Quan Vuong, Tingnan Zhang, Tsang-Wei Edward Lee, Kuang-Huei Lee, Peng Xu, Sean Kirmani, Yuke Zhu, Andy Zeng, Karol Hausman, Nicolas Heess, Chelsea Finn, Sergey Levine, Brian Ichter

专题命中指令微调：prompting(title,abstract)；language model(abstract)；分类 cs.CL、cs.LG

2311.01378 2024-02-06 cs.RO cs.AI cs.LG 84%

Vision-Language Foundation Models as Effective Robot Imitators

Xinghang Li, Minghuan Liu, Hanbo Zhang, Cunjun Yu, Jie Xu, Hongtao Wu, Chilam Cheang, Ya Jing, Weinan Zhang, Huaping Liu, Hang Li, Tao Kong

专题命中指令微调：foundation model(title,abstract)；language model(abstract)；分类 cs.AI、cs.LG

Comments Fix typos. Project page: https://roboflamingo.github.io

2401.04151 2024-01-10 cs.LG cs.CL 84%

Chain of LoRA: Efficient Fine-tuning of Language Models via Residual Learning

Wenhan Xia, Chengwei Qin, Elad Hazan

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.CL、cs.LG

Comments Work in progress

2311.04046 2023-11-08 cs.LG cs.CL 84%

Reinforcement Learning Fine-tuning of Language Models is Biased Towards More Extractable Features

Diogo Cruz, Edoardo Pona, Alex Holness-Tofts, Elias Schmied, Víctor Abia Alonso, Charlie Griffin, Bogdan-Ionut Cirstea

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.CL、cs.LG

2311.02702 2023-11-07 cs.CL cs.AI 84%

Extraction of Atypical Aspects from Customer Reviews: Datasets and Experiments with Language Models

Smita Nannaware, Erfan Al-Hossami, Razvan Bunescu

专题命中指令微调：language model(title,abstract)；prompting(abstract)；分类 cs.CL、cs.AI

Comments Proceedings of the Knowledge-aware and Conversational Recommender Systems Workshop (KaRS) @ RecSys, September 19, 2023

2310.17788 2023-10-30 cs.AI cs.CL 84%

Utilizing Language Models for Energy Load Forecasting

Hao Xue, Flora D. Salim

专题命中指令微调：language model(title,abstract)；prompting(abstract)；分类 cs.CL、cs.AI

Comments BuildSys 2023 Accepted

2310.16040 2023-10-25 cs.CL cs.AI 84%

Instruct and Extract: Instruction Tuning for On-Demand Information Extraction

Yizhu Jiao, Ming Zhong, Sha Li, Ruining Zhao, Siru Ouyang, Heng Ji, Jiawei Han

专题命中指令微调：instruction tuning(title)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments EMNLP 2023

2305.09857 2023-10-25 cs.CL cs.AI 84%

CoEdIT: Text Editing by Task-Specific Instruction Tuning

Vipul Raheja, Dhruv Kumar, Ryan Koo, Dongyeop Kang

专题命中指令微调：instruction tuning(title)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments Accepted to EMNLP 2023 (Findings). 18 pages, 13 tables, 2 figures

2310.14152 2023-10-24 cs.CL cs.LG 84%

Orthogonal Subspace Learning for Language Model Continual Learning

Xiao Wang, Tianze Chen, Qiming Ge, Han Xia, Rong Bao, Rui Zheng, Qi Zhang, Tao Gui, Xuanjing Huang

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.CL、cs.LG

Comments EMNLP 2023 findings

2310.14034 2023-10-24 cs.CL cs.LG 84%

Tree Prompting: Efficient Task Adaptation without Fine-Tuning

John X. Morris, Chandan Singh, Alexander M. Rush, Jianfeng Gao, Yuntian Deng

专题命中指令微调：prompting(title,abstract)；language model(abstract)；分类 cs.CL、cs.LG

Comments Both first authors contributed equally; accepted to EMNLP 2023

2309.12109 2023-09-22 cs.CL cs.AI 84%

PEFTT: Parameter-Efficient Fine-Tuning for low-resource Tibetan pre-trained language models

Zhou Mingjun, Daiqing Zhuoma, Qun Nuo, Nyima Tashi

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.CL、cs.AI

2309.10808 2023-09-21 cs.LG cs.AI physics.ao-ph 84%

AI Foundation Models for Weather and Climate: Applications, Design, and Implementation

S. Karthik Mukkavilli, Daniel Salles Civitarese, Johannes Schmude, Johannes Jakubik, Anne Jones, Nam Nguyen, Christopher Phillips, Sujit Roy, Shraddha Singh, Campbell Watson, Raghu Ganti, Hendrik Hamann, Udaysankar Nair, Rahul Ramachandran, Kommy Weldemariam

专题命中指令微调：foundation model(title,abstract)；language model(abstract)；分类 cs.AI、cs.LG

Comments 44 pages, 1 figure, updated Fig. 1

2308.16824 2023-09-06 cs.CL cs.AI cs.PL cs.SE 84%

Can Programming Languages Boost Each Other via Instruction Tuning?

Daoguang Zan, Ailun Yu, Bo Shen, Jiaxin Zhang, Taihong Chen, Bing Geng, Bei Chen, Jichuan Ji, Yafen Yao, Yongji Wang, Qianxiang Wang

专题命中指令微调：instruction tuning(title)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments Work in progress

1. 指令微调 11619 篇

MM1.5: Methods, Analysis & Insights from Multimodal LLM Fine-tuning

Forget to Flourish: Leveraging Machine-Unlearning on Pretrained Language Models for Privacy Leakage

FUSE-ing Language Models: Zero-Shot Adapter Discovery for Prompt Optimization Across Tokenizers

Forcing Diffuse Distributions out of Language Models

Instruction Tuning for Secure Code Generation

Zero-Shot Continuous Prompt Transfer: Generalizing Task Semantics Across Language Models

Investigating Low-Cost LLM Annotation for~Spoken Dialogue Understanding Datasets

Helpful or Harmful Data? Fine-tuning-free Shapley Attribution for Explaining Language Model Predictions

Robust CLIP: Unsupervised Adversarial Fine-Tuning of Vision Embeddings for Robust Large Vision-Language Models

Transfer Q Star: Principled Decoding for LLM Alignment

Retrieval-Augmented Language Model for Extreme Multi-Label Knowledge Graph Link Prediction

Surprising Efficacy of Fine-Tuned Transformers for Fact-Checking over Larger Language Models

mEdIT: Multilingual Text Editing via Instruction Tuning

Scaling Data Diversity for Fine-Tuning Language Models in Human Alignment

Intent-conditioned and Non-toxic Counterspeech Generation using Multi-Task Instruction Tuning with RLAIF

Two-stage LLM Fine-tuning with Less Specialization and More Generalization

Prompt Perturbation Consistency Learning for Robust Language Models

PIVOT: Iterative Visual Prompting Elicits Actionable Knowledge for VLMs

Vision-Language Foundation Models as Effective Robot Imitators

Chain of LoRA: Efficient Fine-tuning of Language Models via Residual Learning

Reinforcement Learning Fine-tuning of Language Models is Biased Towards More Extractable Features

Extraction of Atypical Aspects from Customer Reviews: Datasets and Experiments with Language Models

Utilizing Language Models for Energy Load Forecasting

Instruct and Extract: Instruction Tuning for On-Demand Information Extraction

CoEdIT: Text Editing by Task-Specific Instruction Tuning

Orthogonal Subspace Learning for Language Model Continual Learning

Tree Prompting: Efficient Task Adaptation without Fine-Tuning

PEFTT: Parameter-Efficient Fine-Tuning for low-resource Tibetan pre-trained language models

AI Foundation Models for Weather and Climate: Applications, Design, and Implementation

Can Programming Languages Boost Each Other via Instruction Tuning?