语言大模型 / LLM

GuardT2I: Defending Text-to-Image Models from Adversarial Prompts

Yijun Yang, Ruiyuan Gao, Xiao Yang, Jianyuan Zhong, Qiang Xu

专题命中 指令微调 ：LLM(abstract)；large language model(abstract)；language model(abstract)

Comments NeurIPS2024 Poster

Fine-Tuning LLMs for Code Mutation: A New Era of Cyber Threats

Mohammad Setak, Pooria Madani

专题命中 指令微调 ：LLM(abstract)；large language model(abstract)；language model(abstract)

Collaborative Knowledge Fusion: A Novel Approach for Multi-task Recommender Systems via LLMs

Chuang Zhao, Xing Su, Ming He, Hongke Zhao, Jianping Fan, Xiaomeng Li

专题命中 指令微调 ：LLM(abstract)；large language model(abstract)；language model(abstract)

GPT vs RETRO: Exploring the Intersection of Retrieval and Parameter-Efficient Fine-Tuning

Aleksander Ficek, Jiaqi Zeng, Oleksii Kuchaiev

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments EMNLP 2024

Does Differential Privacy Impact Bias in Pretrained NLP Models?

Md. Khairul Islam, Andrew Wang, Tianhao Wang, Yangfeng Ji, Judy Fox, Jieyu Zhao

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Github https://github.com/khairulislam/DP-on-NLP-Bias

Aligning LLMs with Human Instructions and Stock Market Feedback in Financial Sentiment Analysis

Zijie Zhao, Roy E. Welsch

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；instruction tuning(abstract)

Towards Infinite-Long Prefix in Transformer

Yingyu Liang, Zhenmei Shi, Zhao Song, Chiwun Yang

专题命中 指令微调 ：language model(abstract)；prompting(abstract)；分类 cs.CL、cs.AI、cs.LG

On Giant's Shoulders: Effortless Weak to Strong by Dynamic Logits Fusion

Chenghao Fan, Zhenyi Lu, Wei Wei, Jie Tian, Xiaoye Qu, Dangyang Chen, Yu Cheng

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted by NeurIPS 2024

SLAM-AAC: Enhancing Audio Captioning with Paraphrasing Augmentation and CLAP-Refine through LLMs

Wenxi Chen, Ziyang Ma, Xiquan Li, Xuenan Xu, Yuzhe Liang, Zhisheng Zheng, Kai Yu, Xie Chen

专题命中 指令微调 ：LLM(abstract)；large language model(abstract)；language model(abstract)

Manual Verbalizer Enrichment for Few-Shot Text Classification

Quang Anh Nguyen, Nadi Tomeh, Mustapha Lebbah, Thierry Charnois, Hanene Azzag, Santiago Cordoba Muñoz

专题命中 指令微调 ：language model(abstract)；prompting(abstract)；分类 cs.CL、cs.AI、cs.LG

$\textbf{PLUM}$: Improving Code LMs with Execution-Guided On-Policy Preference Learning Driven By Synthetic Test Cases

Dylan Zhang, Shizhe Diao, Xueyan Zou, Hao Peng

专题命中 指令微调 ：language model(abstract)；SFT(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Template

SBoRA: Low-Rank Adaptation with Regional Weight Updates

Lai-Man Po, Yuyang Liu, Haoxuan Wu, Tianqi Zhang, Wing-Yin Yu, Zhuohan Wang, Zeyu Jiang, Kun Li

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 16 pages, 4 figures

Obliviate: Neutralizing Task-agnostic Backdoors within the Parameter-efficient Fine-tuning Paradigm

Jaehan Kim, Minkyoo Song, Seung Ho Na, Seungwon Shin

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Under Review

Deconfounded Causality-aware Parameter-Efficient Fine-Tuning for Problem-Solving Improvement of LLMs

Ruoyu Wang, Xiaoxuan Li, Lina Yao

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

ARES: Alternating Reinforcement Learning and Supervised Fine-Tuning for Enhanced Multi-Modal Chain-of-Thought Reasoning Through Diverse AI Feedback

Ju-Seung Byun, Jiyun Chun, Jihyung Kil, Andrew Perrault

专题命中 指令微调 ：SFT(abstract)；RLHF(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to EMNLP 2024

Parameter Competition Balancing for Model Merging

Guodong Du, Junlin Lee, Jing Li, Runhua Jiang, Yifei Guo, Shuyang Yu, Hanting Liu, Sim Kuan Goh, Ho-Kin Tang, Daojing He, Min Zhang

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted by NeurIPS2024

Multitask Mayhem: Unveiling and Mitigating Safety Gaps in LLMs Fine-tuning

Essa Jan, Nouar AlDahoul, Moiz Ali, Faizan Ahmad, Fareed Zaffar, Yasir Zaki

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 19 pages, 11 figures

Advertiser Content Understanding via LLMs for Google Ads Safety

Joseph Wallace, Tushar Dogra, Wei Qiao, Yuan Wang

专题命中 指令微调 ：LLM(abstract)；large language model(abstract)；language model(abstract)

Backtracking Improves Generation Safety

Yiming Zhang, Jianfeng Chi, Hailey Nguyen, Kartikeya Upasani, Daniel M. Bikel, Jason Weston, Eric Michael Smith

专题命中 指令微调 ：language model(abstract)；SFT(abstract)；分类 cs.CL、cs.AI、cs.LG

FullAnno: A Data Engine for Enhancing Image Comprehension of MLLMs

Jing Hao, Yuxiang Zhao, Song Chen, Yanpeng Sun, Qiang Chen, Gang Zhang, Kun Yao, Errui Ding, Jingdong Wang

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；SFT(abstract)

Comments 7 pages, 5 figures, 2 tables

Evaluating the Efficacy of Foundational Models: Advancing Benchmarking Practices to Enhance Fine-Tuning Decision-Making

Oluyemi Enoch Amujo, Shanchieh Jay Yang

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 10 pages, 5 figures, 2 tables, and algorithms

What is in Your Safe Data? Identifying Benign Data that Breaks Safety

Luxi He, Mengzhou Xia, Peter Henderson

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

MMICT: Boosting Multi-Modal Fine-Tuning with In-Context Examples

Tao Chen, Enwei Zhang, Yuting Gao, Ke Li, Xing Sun, Yan Zhang, Hui Li, Rongrong Ji

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments TOMM 2024

TopicTag: Automatic Annotation of NMF Topic Models Using Chain of Thought and Prompt Tuning with LLMs

Selma Wanna, Ryan Barron, Nick Solovyev, Maksim E. Eren, Manish Bhattarai, Kim Rasmussen, Boian S. Alexandrov

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to ACM Symposium on Document Engineering 2024 (DocEng 24), 2024

Improving Multilingual Instruction Finetuning via Linguistically Natural and Diverse Datasets

Sathish Reddy Indurthi, Wenxuan Zhou, Shamil Chollampatt, Ravi Agrawal, Kaiqiang Song, Lingxiao Zhao, Chenguang Zhu

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

LaMDA: Large Model Fine-Tuning via Spectrally Decomposed Low-Dimensional Adaptation

Seyedarmin Azizi, Souvik Kundu, Massoud Pedram

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；分类 cs.CL、cs.AI、cs.LG

The Solution for CVPR2024 Foundational Few-Shot Object Detection Challenge

Hongpeng Pan, Shifeng Yi, Shouwei Yang, Lei Qi, Bing Hu, Yi Xu, Yang Yang

专题命中 指令微调 ：LLM(abstract)；large language model(abstract)；language model(abstract)

Comments CVPR2024 Foundational Few-Shot Object Detection Challenge

MGIMM: Multi-Granularity Instruction Multimodal Model for Attribute-Guided Remote Sensing Image Detailed Description

Cong Yang, Zuchao Li, Lefei Zhang

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；instruction tuning(abstract)

UNIMO-G: Unified Image Generation through Multimodal Conditional Diffusion

Wei Li, Xue Xu, Jiachen Liu, Xinyan Xiao

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；instruction tuning(abstract)

Comments Accepted by ACL 2024, Main Conference, Long Paper

CoLLaVO: Crayon Large Language and Vision mOdel

Byung-Kwan Lee, Beomchan Park, Chae Won Kim, Yong Man Ro

专题命中 指令微调 ：large language model(abstract)；language model(abstract)；instruction tuning(abstract)

Comments ACL 2024 Findings. Code available: https://github.com/ByungKwanLee/CoLLaVO