语言大模型 / LLM - arXivDaily 专题

2405.13432 2024-05-24 cs.CL cs.AI 86%

Disperse-Then-Merge: Pushing the Limits of Instruction Tuning via Alignment Tax Reduction

Tingchen Fu, Deng Cai, Lemao Liu, Shuming Shi, Rui Yan

专题命中指令微调：instruction tuning(title)；large language model(abstract)；language model(abstract)；SFT(abstract)

Comments Accepted to the findings of ACL2024

2310.01352 2024-05-07 cs.CL cs.AI 86%

RA-DIT: Retrieval-Augmented Dual Instruction Tuning

Xi Victoria Lin, Xilun Chen, Mingda Chen, Weijia Shi, Maria Lomeli, Rich James, Pedro Rodriguez, Jacob Kahn, Gergely Szilvasy, Mike Lewis, Luke Zettlemoyer, Scott Yih

专题命中指令微调：instruction tuning(title,abstract)；LLM(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments v4: ICLR 2024 camera-ready version

2308.02151 2024-05-07 cs.CL cs.AI 86%

Retroformer: Retrospective Large Language Agents with Policy Gradient Optimization

Weiran Yao, Shelby Heinecke, Juan Carlos Niebles, Zhiwei Liu, Yihao Feng, Le Xue, Rithesh Murthy, Zeyuan Chen, Jianguo Zhang, Devansh Arpit, Ran Xu, Phil Mui, Huan Wang, Caiming Xiong, Silvio Savarese

专题命中指令微调：language agent(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

2309.17176 2024-05-06 cs.AI cs.CL 86%

AdaRefiner: Refining Decisions of Language Models with Adaptive Feedback

Wanpeng Zhang, Zongqing Lu

专题命中指令微调：language model(title,abstract)；LLM(abstract)；large language model(abstract)；分类 cs.CL、cs.AI

2308.07308 2024-05-03 cs.CL cs.AI 86%

LLM Self Defense: By Self Examination, LLMs Know They Are Being Tricked

Mansi Phute, Alec Helbling, Matthew Hull, ShengYun Peng, Sebastian Szyller, Cory Cornelius, Duen Horng Chau

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

2404.13076 2024-04-23 cs.CL cs.AI 86%

LLM Evaluators Recognize and Favor Their Own Generations

Arjun Panickssery, Samuel R. Bowman, Shi Feng

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

2403.09611 2024-04-22 cs.CV cs.CL cs.LG 86%

MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training

Brandon McKinzie, Zhe Gan, Jean-Philippe Fauconnier, Sam Dodge, Bowen Zhang, Philipp Dufter, Dhruti Shah, Xianzhi Du, Futang Peng, Floris Weers, Anton Belyi, Haotian Zhang, Karanjeet Singh, Doug Kang, Ankur Jain, Hongyu Hè, Max Schwarzer, Tom Gunter, Xiang Kong, Aonan Zhang, Jianyu Wang, Chong Wang, Nan Du, Tao Lei, Sam Wiseman, Guoli Yin, Mark Lee, Zirui Wang, Ruoming Pang, Peter Grasch, Alexander Toshev, Yinfei Yang

专题命中指令微调：LLM(title)；large language model(abstract)；language model(abstract)；prompting(abstract)

2310.01444 2024-04-16 cs.CL cs.AI 86%

Adapting LLM Agents with Universal Feedback in Communication

Kuan Wang, Yadong Lu, Michael Santacroce, Yeyun Gong, Chao Zhang, Yelong Shen

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments Preprint

2304.11872 2024-04-16 cs.CL cs.AI 86%

Generation-driven Contrastive Self-training for Zero-shot Text Classification with Instruction-following LLM

Ruohong Zhang, Yau-Shian Wang, Yiming Yang

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

2404.07439 2024-04-12 cs.AI cs.CL 86%

Behavior Trees Enable Structured Programming of Language Model Agents

Richard Kelley

专题命中指令微调：language model(title,abstract)；instruction tuning(abstract)；RLHF(abstract)；分类 cs.CL、cs.AI

2403.16432 2024-04-10 cs.CL cs.AI 86%

$\textit{LinkPrompt}$: Natural and Universal Adversarial Attacks on Prompt-based Language Models

Yue Xu, Wenjie Wang

专题命中指令微调：language model(title,abstract)；LLM(abstract)；large language model(abstract)；分类 cs.CL、cs.AI

Comments Accepted to the main conference of NAACL2024

2312.15548 2024-04-03 cs.CL cs.AI 86%

YAYI-UIE: A Chat-Enhanced Instruction Tuning Framework for Universal Information Extraction

Xinglin Xiao, Yijie Wang, Nan Xu, Yuqi Wang, Hanxuan Yang, Minzheng Wang, Yin Luo, Lei Wang, Wenji Mao, Daniel Zeng

专题命中指令微调：instruction tuning(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

2311.08685 2024-04-02 cs.CL cs.AI 86%

Safer-Instruct: Aligning Language Models with Automated Preference Data

Taiwei Shi, Kai Chen, Jieyu Zhao

专题命中指令微调：language model(title,abstract)；instruction tuning(abstract)；RLHF(abstract)；分类 cs.CL、cs.AI

Comments 16 pages. NAACL 2024 Camera-ready

2305.11414 2024-03-21 cs.LG cs.AI cs.CR 86%

Federated Foundation Models: Privacy-Preserving and Collaborative Learning for Large Models

Sixing Yu, J. Pablo Muñoz, Ali Jannesari

专题命中指令微调：foundation model(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.AI、cs.LG

Comments Accepted at the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)

2311.10081 2024-03-20 cs.CV cs.CL cs.LG 86%

DRESS: Instructing Large Vision-Language Models to Align and Interact with Humans via Natural Language Feedback

Yangyi Chen, Karan Sikka, Michael Cogswell, Heng Ji, Ajay Divakaran

专题命中指令微调：language model(title,abstract)；large language model(abstract)；instruction tuning(abstract)；分类 cs.CL、cs.LG

Comments CVPR 2024. The feedback datasets are released at: https://huggingface.co/datasets/YangyiYY/LVLM_NLF

2403.06221 2024-03-12 cs.AI cs.CL cs.IR 86%

TRAD: Enhancing LLM Agents with Step-Wise Thought Retrieval and Aligned Decision

Ruiwen Zhou, Yingxuan Yang, Muning Wen, Ying Wen, Wenhao Wang, Chunling Xi, Guoqiang Xu, Yong Yu, Weinan Zhang

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments Codes available at: https://github.com/skyriver-2000/TRAD-Official

2403.01851 2024-03-05 cs.CL cs.AI 86%

Rethinking LLM Language Adaptation: A Case Study on Chinese Mixtral

Yiming Cui, Xin Yao

专题命中指令微调：LLM(title)；large language model(abstract)；language model(abstract)；foundation model(abstract)

Comments 13 pages

2402.08846 2024-02-15 cs.CL cs.AI cs.MM cs.SD eess.AS 86%

An Embarrassingly Simple Approach for LLM with Strong ASR Capacity

Ziyang Ma, Guanrou Yang, Yifan Yang, Zhifu Gao, Jiaming Wang, Zhihao Du, Fan Yu, Qian Chen, Siqi Zheng, Shiliang Zhang, Xie Chen

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments Working in progress and will open-source soon

2402.02318 2024-02-07 cs.LG cs.CL 86%

Diversity Measurement and Subset Selection for Instruction Tuning Datasets

Peiqi Wang, Yikang Shen, Zhen Guo, Matthew Stallone, Yoon Kim, Polina Golland, Rameswar Panda

专题命中指令微调：instruction tuning(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.LG

2309.08958 2024-02-01 cs.CL cs.AI 86%

Monolingual or Multilingual Instruction Tuning: Which Makes a Better Alpaca

Pinzhen Chen, Shaoxiong Ji, Nikolay Bogoychev, Andrey Kutuzov, Barry Haddow, Kenneth Heafield

专题命中指令微调：instruction tuning(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments Accepted to Findings of ACL: EACL 2024. Added human evaluation and shortened writing

2401.12915 2024-01-24 cs.AI cs.CL cs.CV 86%

Red Teaming Visual Language Models

Mukai Li, Lei Li, Yuwei Yin, Masood Ahmed, Zhenguang Liu, Qi Liu

专题命中指令微调：language model(title,abstract)；large language model(abstract)；SFT(abstract)；分类 cs.CL、cs.AI

Comments Working in progress

2401.05033 2024-01-11 cs.CL cs.AI 86%

Bootstrapping LLM-based Task-Oriented Dialogue Agents via Self-Talk

Dennis Ulmer, Elman Mansimov, Kaixiang Lin, Justin Sun, Xibin Gao, Yi Zhang

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

2307.15504 2024-01-09 cs.CL cs.AI 86%

Exploring Format Consistency for Instruction Tuning

Shihao Liang, Runchu Tian, Kunlun Zhu, Yujia Qin, Huadong Wang, Xin Cong, Zhiyuan Liu, Xiaojiang Liu, Maosong Sun

专题命中指令微调：instruction tuning(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

2309.01105 2024-01-03 cs.AI cs.CL 86%

A Study on the Implementation of Generative AI Services Using an Enterprise Data-Based LLM Application Architecture

Cheonsu Jeong

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

2308.10253 2023-12-29 cs.CV cs.CL cs.LG 86%

StableLLaVA: Enhanced Visual Instruction Tuning with Synthesized Image-Dialogue Data

Yanda Li, Chi Zhang, Gang Yu, Zhibin Wang, Bin Fu, Guosheng Lin, Chunhua Shen, Ling Chen, Yunchao Wei

专题命中指令微调：instruction tuning(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.LG

Comments Project page: https://github.com/icoz69/StableLLAVA

2311.18260 2023-12-22 eess.IV cs.CL cs.CV cs.LG 86%

Consensus, dissensus and synergy between clinicians and specialist foundation models in radiology report generation

Ryutaro Tanno, David G. T. Barrett, Andrew Sellergren, Sumedh Ghaisas, Sumanth Dathathri, Abigail See, Johannes Welbl, Karan Singhal, Shekoofeh Azizi, Tao Tu, Mike Schaekermann, Rhys May, Roy Lee, SiWai Man, Zahra Ahmed, Sara Mahdavi, Yossi Matias, Joelle Barral, Ali Eslami, Danielle Belgrave, Vivek Natarajan, Shravya Shetty, Pushmeet Kohli, Po-Sen Huang, Alan Karthikesalingam, Ira Ktena

专题命中指令微调：foundation model(title,abstract)；language model(abstract)；prompting(abstract)；分类 cs.CL、cs.LG

2310.15539 2023-12-18 cs.CL cs.AI 86%

SteloCoder: a Decoder-Only LLM for Multi-Language to Python Code Translation

Jialing Pan, Adrien Sadé, Jin Kim, Eric Soriano, Guillem Sole, Sylvain Flamant

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

2310.10158 2023-12-15 cs.CL cs.AI 86%

Character-LLM: A Trainable Agent for Role-Playing

Yunfan Shao, Linyang Li, Junqi Dai, Xipeng Qiu

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI

Comments To appear at EMNLP 2023; Repo at https://github.com/choosewhatulike/trainable-agents

2312.02798 2023-12-06 cs.LG cs.CL 86%

Weakly Supervised Detection of Hallucinations in LLM Activations

Miriam Rateike, Celia Cintas, John Wamburu, Tanya Akumu, Skyler Speakman

专题命中指令微调：LLM(title,abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.LG

2310.03211 2023-11-29 cs.CL cs.AI cs.CV 86%

On the Performance of Multimodal Language Models

Utsav Garg, Erhan Bas

专题命中指令微调：language model(title,abstract)；large language model(abstract)；instruction tuning(abstract)；分类 cs.CL、cs.AI

1. 指令微调 11667 篇

Disperse-Then-Merge: Pushing the Limits of Instruction Tuning via Alignment Tax Reduction

RA-DIT: Retrieval-Augmented Dual Instruction Tuning

Retroformer: Retrospective Large Language Agents with Policy Gradient Optimization

AdaRefiner: Refining Decisions of Language Models with Adaptive Feedback

LLM Self Defense: By Self Examination, LLMs Know They Are Being Tricked

LLM Evaluators Recognize and Favor Their Own Generations

MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training

Adapting LLM Agents with Universal Feedback in Communication

Generation-driven Contrastive Self-training for Zero-shot Text Classification with Instruction-following LLM

Behavior Trees Enable Structured Programming of Language Model Agents

$\textit{LinkPrompt}$: Natural and Universal Adversarial Attacks on Prompt-based Language Models

YAYI-UIE: A Chat-Enhanced Instruction Tuning Framework for Universal Information Extraction

Safer-Instruct: Aligning Language Models with Automated Preference Data

Federated Foundation Models: Privacy-Preserving and Collaborative Learning for Large Models

DRESS: Instructing Large Vision-Language Models to Align and Interact with Humans via Natural Language Feedback

TRAD: Enhancing LLM Agents with Step-Wise Thought Retrieval and Aligned Decision

Rethinking LLM Language Adaptation: A Case Study on Chinese Mixtral

An Embarrassingly Simple Approach for LLM with Strong ASR Capacity

Diversity Measurement and Subset Selection for Instruction Tuning Datasets

Monolingual or Multilingual Instruction Tuning: Which Makes a Better Alpaca

Red Teaming Visual Language Models

Bootstrapping LLM-based Task-Oriented Dialogue Agents via Self-Talk

Exploring Format Consistency for Instruction Tuning

A Study on the Implementation of Generative AI Services Using an Enterprise Data-Based LLM Application Architecture

StableLLaVA: Enhanced Visual Instruction Tuning with Synthesized Image-Dialogue Data

Consensus, dissensus and synergy between clinicians and specialist foundation models in radiology report generation

SteloCoder: a Decoder-Only LLM for Multi-Language to Python Code Translation

Character-LLM: A Trainable Agent for Role-Playing

Weakly Supervised Detection of Hallucinations in LLM Activations

On the Performance of Multimodal Language Models