语言大模型 / LLM

RoSA: Accurate Parameter-Efficient Fine-Tuning via Robust Adaptation

Mahdi Nikdan, Soroush Tabesh, Elvir Crnčević, Dan Alistarh

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Low-rank finetuning for LLMs: A fairness perspective

Saswat Das, Marco Romanelli, Cuong Tran, Zarreen Reza, Bhavya Kailkhura, Ferdinando Fioretto

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Fine-tuning Multimodal LLMs to Follow Zero-shot Demonstrative Instructions

Juncheng Li, Kaihang Pan, Zhiqi Ge, Minghe Gao, Wei Ji, Wenqiao Zhang, Tat-Seng Chua, Siliang Tang, Hanwang Zhang, Yueting Zhuang

专题命中 指令微调 ：LLM(abstract)；large language model(abstract)；language model(abstract)

Comments Accepted by ICLR 2024 (Spotlight)

Parameter-Efficient Fine-Tuning with Discrete Fourier Transform

Ziqi Gao, Qichao Wang, Aochuan Chen, Zijing Liu, Bingzhe Wu, Liang Chen, Jia Li

专题命中 指令微调 ：foundation model(abstract)；instruction tuning(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted by ICML 2024

"In-Context Learning" or: How I learned to stop worrying and love "Applied Information Retrieval"

Andrew Parry, Debasis Ganguly, Manish Chandra

专题命中 指令微调 ：LLM(abstract)；large language model(abstract)；language model(abstract)

Comments 9 Pages, 3 Figures, Accepted as Perspective paper to SIGIR 2024

Exploring the Capability of LLMs in Performing Low-Level Visual Analytic Tasks on SVG Data Visualizations

Zhongzheng Xu, Emily Wall

专题命中 指令微调 ：LLM(abstract)；large language model(abstract)；language model(abstract)

Shears: Unstructured Sparsity with Neural Low-rank Adapter Search

J. Pablo Muñoz, Jinjie Yuan, Nilesh Jain

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 2024 Annual Conference of the North American Chapter of the Association for Computational Linguistics (Industry Track)

LLMem: Estimating GPU Memory Usage for Fine-Tuning Pre-Trained LLMs

Taeho Kim, Yanming Wang, Vatshank Chaturvedi, Lokesh Gupta, Seyeon Kim, Yongin Kwon, Sangtae Ha

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 9 pages, 9 figures, accepted to IJCAI 2024

From Bytes to Borsch: Fine-Tuning Gemma and Mistral for the Ukrainian Language Representation

Artur Kiulian, Anton Polishko, Mykola Khandoga, Oryna Chubych, Jack Connor, Raghav Ravishankar, Adarsh Shirawalmath

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

UMBCLU at SemEval-2024 Task 1A and 1C: Semantic Textual Relatedness with and without machine translation

Shubhashis Roy Dipta, Sai Vallurupalli

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted at SemEval 2024 (Colocated with NAACL 2024)

Using Persuasive Writing Strategies to Explain and Detect Health Misinformation

Danial Kamali, Joseph Romain, Huiyi Liu, Wei Peng, Jingbo Meng, Parisa Kordjamshidi

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted at LREC-CoLING-2024

A Note on LoRA

Vlad Fomenko, Han Yu, Jongho Lee, Stanley Hsieh, Weizhu Chen

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

PairAug: What Can Augmented Image-Text Pairs Do for Radiology?

Yutong Xie, Qi Chen, Sinuo Wang, Minh-Son To, Iris Lee, Ee Win Khoo, Kerolos Hendy, Daniel Koh, Yong Xia, Qi Wu

专题命中 指令微调 ：LLM(abstract)；large language model(abstract)；language model(abstract)

Comments Accepted to CVPR2024

Baichuan2-Sum: Instruction Finetune Baichuan2-7B Model for Dialogue Summarization

Jianfei Xiao, Yancan Chen, Yimin Ou, Hanyi Yu, Kai Shu, Yiyong Xiao

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Low-Rank Adaptation for Multilingual Summarization: An Empirical Study

Chenxi Whitehouse, Fantine Huot, Jasmijn Bastings, Mostafa Dehghani, Chu-Cheng Lin, Mirella Lapata

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Findings of NAACL 2024

LlamBERT: Large-scale low-cost data annotation in NLP

Bálint Csanády, Lajos Muzsai, Péter Vedres, Zoltán Nádasdy, András Lukács

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 11 pages, 1 figure

The Expressive Power of Low-Rank Adaptation

Yuchen Zeng, Kangwook Lee

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 40 pages, 5 figures

Team Trifecta at Factify5WQA: Setting the Standard in Fact Verification with Fine-Tuning

Shang-Hsuan Chiang, Ming-Chih Lo, Lin-Wei Chao, Wen-Chih Peng

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted by AAAI 2024 Workshop: FACTIFY 3.0 - Workshop Series on Multimodal Fact-Checking and Hate Speech Detection

GiT: Towards Generalist Vision Transformer through Universal Language Interface

Haiyang Wang, Hao Tang, Li Jiang, Shaoshuai Shi, Muhammad Ferjad Naeem, Hongsheng Li, Bernt Schiele, Liwei Wang

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；foundation model(abstract)

Mafin: Enhancing Black-Box Embeddings with Model Augmented Fine-Tuning

Mingtian Zhang, Shawn Lan, Peter Hayes, David Barber

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Simulating Family Conversations using LLMs: Demonstration of Parenting Styles

Frank Tian-fang Ye, Xiaozi Gao

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；prompting(abstract)

A Fine-tuning Enhanced RAG System with Quantized Influence Measure as AI Judge

Keshav Rangan, Yiqiao Yin

专题命中 指令微调 ：LLM(abstract)；large language model(abstract)；language model(abstract)

Comments 17 pages, 4 figures

VQAttack: Transferable Adversarial Attacks on Visual Question Answering via Pre-trained Models

Ziyi Yin, Muchao Ye, Tianrong Zhang, Jiaqi Wang, Han Liu, Jinghui Chen, Ting Wang, Fenglong Ma

专题命中 指令微调 ：LLM(abstract)；large language model(abstract)；language model(abstract)

Comments AAAI 2024, 11 pages

DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning

Zhengxiang Shi, Aldo Lipani

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments ICLR 2024. Code is available at https://github.com/ZhengxiangShi/DePT

LoTR: Low Tensor Rank Weight Adaptation

Daniel Bershatsky, Daria Cherniuk, Talgat Daulbaev, Aleksandr Mikhalev, Ivan Oseledets

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Submitted; missing author and sections were added;

Fine-Tuning or Retrieval? Comparing Knowledge Injection in LLMs

Oded Ovadia, Menachem Brief, Moshik Mishaeli, Oren Elisha

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Matcher: Segment Anything with One Shot Using All-Purpose Feature Matching

Yang Liu, Muzhi Zhu, Hengtao Li, Hao Chen, Xinlong Wang, Chunhua Shen

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；foundation model(abstract)

Comments Accepted to ICLR2024

Lessons from Building StackSpot AI: A Contextualized AI Coding Assistant

Gustavo Pinto, Cleidson de Souza, João Batista Neto, Alberto de Souza, Tarcísio Gotto, Edward Monteiro

专题命中 指令微调 ：LLM(abstract)；large language model(abstract)；language model(abstract)

Towards Improving Document Understanding: An Exploration on Text-Grounding via MLLMs

Yonghui Wang, Wengang Zhou, Hao Feng, Keyi Zhou, Houqiang Li

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；instruction tuning(abstract)

From Text to Motion: Grounding GPT-4 in a Humanoid Robot "Alter3"

Takahide Yoshida, Atsushi Masumori, Takashi Ikegami

专题命中 指令微调 ：LLM(abstract)；large language model(abstract)；language model(abstract)

Comments 15 pages, 9 figures