语言大模型 / LLM - arXivDaily 专题

2412.04903 2024-12-17 cs.CV cs.AI cs.CL cs.LG 80%

EACO: Enhancing Alignment in Multimodal LLMs via Critical Observation

Yongxin Wang, Meng Cao, Haokun Lin, Mingfei Han, Liang Ma, Jin Jiang, Yuhao Cheng, Xiaodan Liang

专题命中指令微调：large language model(abstract)；language model(abstract)；preference optimization(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 19 pages

2411.15804 2024-11-26 cs.CL cs.AI cs.LG 80%

LoRA-Mini : Adaptation Matrices Decomposition and Selective Training

Ayush Singh, Rajdeep Aher, Shivank Garg

专题命中指令微调：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 11 pages

2407.15850 2024-11-25 cs.CV 80%

AutoAD-Zero: A Training-Free Framework for Zero-Shot Audio Description

Junyu Xie, Tengda Han, Max Bain, Arsha Nagrani, Gül Varol, Weidi Xie, Andrew Zisserman

专题命中指令微调：LLM(abstract)；large language model(abstract)；language model(abstract)；prompting(abstract)

Comments Project Page: https://www.robots.ox.ac.uk/~vgg/research/autoad-zero/

2403.11585 2024-11-22 cs.LG cs.AI cs.CL cs.PL cs.SE 80%

Linguacodus: A Synergistic Framework for Transformative Code Generation in Machine Learning Pipelines

Ekaterina Trofimova, Emil Sataev, Andrey E. Ustyuzhanin

专题命中指令微调：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

2411.13451 2024-11-21 cs.AI cs.CL cs.LG 80%

AdaptAgent: Adapting Multimodal Web Agents with Few-Shot Learning from Human Demonstrations

Gaurav Verma, Rachneet Kaur, Nishan Srishankar, Zhen Zeng, Tucker Balch, Manuela Veloso

专题命中指令微调：large language model(abstract)；language model(abstract)；prompting(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 18 pages, 3 figures, an abridged version to appear in NeurIPS 2024 AFM Workshop

2411.10879 2024-11-19 cs.CL cs.AI cs.LG cs.SD eess.AS 80%

BanglaDialecto: An End-to-End AI-Powered Regional Speech Standardization

Md. Nazmus Sadat Samin, Jawad Ibn Ahad, Tanjila Ahmed Medha, Fuad Rahman, Mohammad Ruhul Amin, Nabeel Mohammed, Shafin Rahman

专题命中指令微调：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted in 2024 IEEE International Conference on Big Data (IEEE BigData)

2410.21338 2024-11-11 cs.CL cs.AI cs.LG 80%

FinTeamExperts: Role Specialized MOEs For Financial Analysis

Yue Yu, Prayag Tiwari

专题命中指令微调：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

2402.06255 2024-11-01 cs.LG cs.AI cs.CL cs.CR 80%

Fight Back Against Jailbreaking via Prompt Adversarial Tuning

Yichuan Mo, Yuji Wang, Zeming Wei, Yisen Wang

专题命中指令微调：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

2410.18975 2024-10-31 cs.CV cs.AI cs.CL cs.GR cs.LG 80%

Unbounded: A Generative Infinite Game of Character Life Simulation

Jialu Li, Yuanzhen Li, Neal Wadhwa, Yael Pritch, David E. Jacobs, Michael Rubinstein, Mohit Bansal, Nataniel Ruiz

专题命中指令微调：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Project page: https://generative-infinite-game.github.io/

2409.15657 2024-10-31 cs.AI cs.CL cs.LG 80%

M$^2$PT: Multimodal Prompt Tuning for Zero-shot Instruction Learning

Taowen Wang, Yiyang Liu, James Chenhao Liang, junhan zhao, Yiming Cui, Yuning Mao, Shaoliang Nie, Jiahao Liu, Fuli Feng, Zenglin Xu, Cheng Han, Lifu Huang, Qifan Wang, Dongfang Liu

专题命中指令微调：large language model(abstract)；language model(abstract)；instruction tuning(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments EMNLP 2024

2410.16710 2024-10-23 cs.AI cs.CL cs.LG 80%

Influential Language Data Selection via Gradient Trajectory Pursuit

Zhiwei Deng, Tao Li, Yang Li

专题命中指令微调：large language model(abstract)；language model(abstract)；instruction tuning(abstract)；分类 cs.CL、cs.AI、cs.LG

2403.09572 2024-10-16 cs.CV 80%

Eyes Closed, Safety On: Protecting Multimodal LLMs via Image-to-Text Transformation

Yunhao Gou, Kai Chen, Zhili Liu, Lanqing Hong, Hang Xu, Zhenguo Li, Dit-Yan Yeung, James T. Kwok, Yu Zhang

专题命中指令微调：LLM(abstract)；large language model(abstract)；language model(abstract)；SFT(abstract)

Comments ECCV2024 (Project Page: https://gyhdog99.github.io/projects/ecso/)

2402.07876 2024-10-11 cs.LG cs.AI cs.CL 80%

Policy Improvement using Language Feedback Models

Victor Zhong, Dipendra Misra, Xingdi Yuan, Marc-Alexandre Côté

专题命中指令微调：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments NeurIPS 2024

2407.08044 2024-09-30 cs.CL cs.AI cs.LG 80%

RoLoRA: Fine-tuning Rotated Outlier-free LLMs for Effective Weight-Activation Quantization

Xijie Huang, Zechun Liu, Shih-Yang Liu, Kwang-Ting Cheng

专题命中指令微调：large language model(abstract)；language model(abstract)；post-training(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments EMNLP 2024 Findings, Codes: https://github.com/HuangOwen/RoLoRA, Models: https://huggingface.co/collections/ScarletAce/rolora-66f5f228a90681c7c4512b28

2405.09673 2024-09-24 cs.LG cs.AI cs.CL 80%

LoRA Learns Less and Forgets Less

Dan Biderman, Jacob Portes, Jose Javier Gonzalez Ortiz, Mansheej Paul, Philip Greengard, Connor Jennings, Daniel King, Sam Havens, Vitaliy Chiley, Jonathan Frankle, Cody Blakeney, John P. Cunningham

专题命中指令微调：large language model(abstract)；language model(abstract)；pretraining(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Final version with new experiments and analyses, as accepted to Transactions on Machine Learning Research, August 2024 (Featured Certification). https://openreview.net/forum?id=aloEru2qCG&noteId=Jb3PQNQDI2

2408.16667 2024-08-30 cs.LG cs.AI cs.CL cs.MA 80%

Iterative Graph Alignment

Fangyuan Yu, Hardeep Singh Arora, Matt Johnson

专题命中指令微调：LLM(abstract)；SFT(abstract)；prompting(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 12 pages, 4 figures

2408.14484 2024-08-28 cs.AI cs.CL cs.LG 80%

Agentic Retrieval-Augmented Generation for Time Series Analysis

Chidaksh Ravuru, Sagar Srinivas Sakhinana, Venkataramana Runkana

专题命中指令微调：language model(abstract)；instruction tuning(abstract)；preference optimization(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Paper was accepted for Undergraduate Consortium at ACM KDD, 2024. Please find the link: https://kdd2024.kdd.org/undergraduate-consortium/

2408.03936 2024-08-08 cs.CL cs.AI cs.LG 80%

SLIM-RAFT: A Novel Fine-Tuning Approach to Improve Cross-Linguistic Performance for Mercosur Common Nomenclature

Vinícius Di Oliveira, Yuri Façanha Bezerra, Li Weigang, Pedro Carvalho Brom, Victor Rafael R. Celestino

专题命中指令微调：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 13 pages, 1 figure, to be publish in International Conference on Web Information Systems and Technologies - WEBIST 2024 proceedings

2403.07508 2024-07-18 cs.CV 80%

MoAI: Mixture of All Intelligence for Large Language and Vision Models

Byung-Kwan Lee, Beomchan Park, Chae Won Kim, Yong Man Ro

专题命中指令微调：LLM(abstract)；large language model(abstract)；language model(abstract)；instruction tuning(abstract)

Comments ECCV 2024. Code available: https://github.com/ByungKwanLee/MoAI

2403.11299 2024-07-16 cs.CV cs.AI cs.CL cs.LG 80%

SQ-LLaVA: Self-Questioning for Large Vision-Language Assistant

Guohao Sun, Can Qin, Jiamian Wang, Zeyuan Chen, Ran Xu, Zhiqiang Tao

专题命中指令微调：large language model(abstract)；language model(abstract)；instruction tuning(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments ECCV 2024

2407.02485 2024-07-03 cs.CL cs.AI cs.IR cs.LG 80%

RankRAG: Unifying Context Ranking with Retrieval-Augmented Generation in LLMs

Yue Yu, Wei Ping, Zihan Liu, Boxin Wang, Jiaxuan You, Chao Zhang, Mohammad Shoeybi, Bryan Catanzaro

专题命中指令微调：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

2407.00203 2024-07-02 cs.CV 80%

PathGen-1.6M: 1.6 Million Pathology Image-text Pairs Generation through Multi-agent Collaboration

Yuxuan Sun, Yunlong Zhang, Yixuan Si, Chenglu Zhu, Zhongyi Shui, Kai Zhang, Jingxiong Li, Xingheng Lyu, Tao Lin, Lin Yang

专题命中指令微调：LLM(abstract)；large language model(abstract)；language model(abstract)；instruction tuning(abstract)

Comments 13 pages, 3 figures

2406.19736 2024-07-01 cs.CV cs.AI cs.CL cs.LG 80%

MM-Instruct: Generated Visual Instructions for Large Multimodal Model Alignment

Jihao Liu, Xin Huang, Jinliang Zheng, Boxiao Liu, Jia Wang, Osamu Yoshie, Yu Liu, Hongsheng Li

专题命中指令微调：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Dataset and models are available at https://github.com/jihaonew/MM-Instruct

2406.14764 2024-06-24 cs.IR cs.AI cs.CL cs.LG 80%

RE-AdaptIR: Improving Information Retrieval through Reverse Engineered Adaptation

William Fleshman, Benjamin Van Durme

专题命中指令微调：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

2406.09559 2024-06-17 cs.CL cs.AI cs.LG 80%

Decoding the Diversity: A Review of the Indic AI Research Landscape

Sankalp KJ, Vinija Jain, Sreyoshi Bhaduri, Tamoghna Roy, Aman Chadha

专题命中指令微调：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 27 pages, 1 figure

2405.19787 2024-06-03 cs.CL cs.AI cs.LG cs.LO cs.PL 80%

From Symbolic Tasks to Code Generation: Diversification Yields Better Task Performers

Dylan Zhang, Justin Wang, Francois Charton

专题命中指令微调：large language model(abstract)；language model(abstract)；instruction tuning(abstract)；分类 cs.CL、cs.AI、cs.LG

2305.04207 2024-05-21 cs.SE 80%

No More Manual Tests? Evaluating and Improving ChatGPT for Unit Test Generation

Zhiqiang Yuan, Yiling Lou, Mingwei Liu, Shiji Ding, Kaixin Wang, Yixuan Chen, Xin Peng

专题命中指令微调：LLM(abstract)；large language model(abstract)；language model(abstract)；instruction tuning(abstract)

2405.02596 2024-05-07 cs.LG cs.AI cs.CL 80%

Random Masking Finds Winning Tickets for Parameter Efficient Fine-tuning

Jing Xu, Jingzhao Zhang

专题命中指令微调：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments ICML 2024

2405.00732 2024-05-03 cs.CL cs.AI cs.LG 80%

LoRA Land: 310 Fine-tuned LLMs that Rival GPT-4, A Technical Report

Justin Zhao, Timothy Wang, Wael Abid, Geoffrey Angus, Arnav Garg, Jeffery Kinnison, Alex Sherstinsky, Piero Molino, Travis Addair, Devvret Rishi

专题命中指令微调：LLM(abstract)；large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

2404.05143 2024-04-09 cs.CL cs.AI cs.LG 80%

Plug and Play with Prompts: A Prompt Tuning Approach for Controlling Text Generation

Rohan Deepak Ajwani, Zining Zhu, Jonathan Rose, Frank Rudzicz

专题命中指令微调：large language model(abstract)；language model(abstract)；small language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 9 pages, 3 figures, Presented at Deployable AI Workshop at AAAI-2024

Journal ref Presented at Deployable AI Workshop at AAAI-2024

1. 指令微调 11653 篇

EACO: Enhancing Alignment in Multimodal LLMs via Critical Observation

LoRA-Mini : Adaptation Matrices Decomposition and Selective Training

AutoAD-Zero: A Training-Free Framework for Zero-Shot Audio Description

Linguacodus: A Synergistic Framework for Transformative Code Generation in Machine Learning Pipelines

AdaptAgent: Adapting Multimodal Web Agents with Few-Shot Learning from Human Demonstrations

BanglaDialecto: An End-to-End AI-Powered Regional Speech Standardization

FinTeamExperts: Role Specialized MOEs For Financial Analysis

Fight Back Against Jailbreaking via Prompt Adversarial Tuning

Unbounded: A Generative Infinite Game of Character Life Simulation

M$^2$PT: Multimodal Prompt Tuning for Zero-shot Instruction Learning

Influential Language Data Selection via Gradient Trajectory Pursuit

Eyes Closed, Safety On: Protecting Multimodal LLMs via Image-to-Text Transformation

Policy Improvement using Language Feedback Models

RoLoRA: Fine-tuning Rotated Outlier-free LLMs for Effective Weight-Activation Quantization

LoRA Learns Less and Forgets Less

Iterative Graph Alignment

Agentic Retrieval-Augmented Generation for Time Series Analysis

SLIM-RAFT: A Novel Fine-Tuning Approach to Improve Cross-Linguistic Performance for Mercosur Common Nomenclature

MoAI: Mixture of All Intelligence for Large Language and Vision Models

SQ-LLaVA: Self-Questioning for Large Vision-Language Assistant

RankRAG: Unifying Context Ranking with Retrieval-Augmented Generation in LLMs

PathGen-1.6M: 1.6 Million Pathology Image-text Pairs Generation through Multi-agent Collaboration

MM-Instruct: Generated Visual Instructions for Large Multimodal Model Alignment

RE-AdaptIR: Improving Information Retrieval through Reverse Engineered Adaptation

Decoding the Diversity: A Review of the Indic AI Research Landscape

From Symbolic Tasks to Code Generation: Diversification Yields Better Task Performers

No More Manual Tests? Evaluating and Improving ChatGPT for Unit Test Generation

Random Masking Finds Winning Tickets for Parameter Efficient Fine-tuning

LoRA Land: 310 Fine-tuned LLMs that Rival GPT-4, A Technical Report

Plug and Play with Prompts: A Prompt Tuning Approach for Controlling Text Generation