语言大模型 / LLM - arXivDaily 专题

2312.13881 2023-12-22 cs.CL 83%

Diversifying Knowledge Enhancement of Biomedical Language Models using Adapter Modules and Knowledge Graphs

Juraj Vladika, Alexander Fichtl, Florian Matthes

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.CL

Comments Accepted as Full Paper to ICAART 2024

2312.12148 2023-12-20 cs.CL 83%

Parameter-Efficient Fine-Tuning Methods for Pretrained Language Models: A Critical Review and Assessment

Lingling Xu, Haoran Xie, Si-Zhao Joe Qin, Xiaohui Tao, Fu Lee Wang

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.CL

Comments 20 pages, 4 figures

2312.10365 2023-12-19 cs.DC cs.AI 83%

SPT: Fine-Tuning Transformer-based Language Models Efficiently with Sparsification

Yuntao Gui, Xiao Yan, Peiqi Yin, Han Yang, James Cheng

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.AI

Comments Firstly submitted to VLDB November 1, 2023, rejection received on December 15, 2023

2311.18812 2023-12-01 cs.CL 83%

What Do Llamas Really Think? Revealing Preference Biases in Language Model Representations

Raphael Tang, Xinyu Zhang, Jimmy Lin, Ferhan Ture

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.CL

Comments 10 pages, 5 figures

2305.14919 2023-11-07 cs.CL 83%

Frugal Prompting for Dialog Models

Bishal Santra, Sakya Basak, Abhinandan De, Manish Gupta, Pawan Goyal

专题命中指令微调：prompting(title)；large language model(abstract)；language model(abstract)；分类 cs.CL

Comments Preprint, To appear in EMNLP 2023 (Findings); First two authors have equal contribution

2310.19915 2023-11-01 cs.LG q-bio.BM 83%

GPCR-BERT: Interpreting Sequential Design of G Protein Coupled Receptors Using Protein Language Models

Seongwon Kim, Parisa Mollaei, Akshay Antony, Rishikesh Magar, Amir Barati Farimani

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.LG

Comments 25 pages, 5 figures

2305.15076 2023-10-24 cs.CL 83%

Meta-Learning Online Adaptation of Language Models

Nathan Hu, Eric Mitchell, Christopher D. Manning, Chelsea Finn

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.CL

Comments EMNLP 2023 Camera Ready

2305.13723 2023-10-23 cs.CL 83%

PIEClass: Weakly-Supervised Text Classification with Prompting and Noise-Robust Iterative Ensemble Training

Yunyi Zhang, Minhao Jiang, Yu Meng, Yu Zhang, Jiawei Han

专题命中指令微调：prompting(title,abstract)；language model(abstract)；分类 cs.CL

Comments Accepted to EMNLP 2023 Main Conference

2310.10219 2023-10-17 cs.CV cs.AI 83%

Using Global Land Cover Product as Prompt for Cropland Mapping via Visual Foundation Model

Chao Tao, Aoran Hu, Rong Xiao, Haifeng Li, Yuze Wang

专题命中指令微调：foundation model(title,abstract)；prompting(abstract)；分类 cs.AI

2310.09424 2023-10-17 cs.CL cs.HC cs.SD eess.AS 83%

SALM: Speech-augmented Language Model with In-context Learning for Speech Recognition and Translation

Zhehuai Chen, He Huang, Andrei Andrusenko, Oleksii Hrinchuk, Krishna C. Puvvada, Jason Li, Subhankar Ghosh, Jagadeesh Balam, Boris Ginsburg

专题命中指令微调：language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments submit to ICASSP 2024

2305.01711 2023-10-09 cs.CL 83%

Don't Stop Pretraining? Make Prompt-based Fine-tuning Powerful Learner

Zhengxiang Shi, Aldo Lipani

专题命中指令微调：pretraining(title)；language model(abstract)；instruction tuning(abstract)；分类 cs.CL

Comments NeurIPS 2023 (Main Track) Camera-ready Version. Code is available at https://github.com/ZhengxiangShi/PowerfulPromptFT

2310.03331 2023-10-06 cs.LG 83%

Fine-tune Language Models to Approximate Unbiased In-context Learning

Timothy Chu, Zhao Song, Chiwun Yang

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.LG

2308.15010 2023-08-30 cs.CL 83%

TransPrompt v2: A Transferable Prompting Framework for Cross-task Text Classification

Jianing Wang, Chengyu Wang, Cen Chen, Ming Gao, Jun Huang, Aoying Zhou

专题命中指令微调：prompting(title,abstract)；language model(abstract)；分类 cs.CL

2307.12914 2023-07-26 cs.CV cs.AI 83%

Towards a Visual-Language Foundation Model for Computational Pathology

Ming Y. Lu, Bowen Chen, Drew F. K. Williamson, Richard J. Chen, Ivy Liang, Tong Ding, Guillaume Jaume, Igor Odintsov, Andrew Zhang, Long Phi Le, Georg Gerber, Anil V Parwani, Faisal Mahmood

专题命中指令微调：foundation model(title,abstract)；pretraining(abstract)；分类 cs.AI

2307.09474 2023-07-19 cs.CL cs.CV 83%

ChatSpot: Bootstrapping Multimodal LLMs via Precise Referring Instruction Tuning

Liang Zhao, En Yu, Zheng Ge, Jinrong Yang, Haoran Wei, Hongyu Zhou, Jianjian Sun, Yuang Peng, Runpei Dong, Chunrui Han, Xiangyu Zhang

专题命中指令微调：instruction tuning(title)；large language model(abstract)；language model(abstract)；分类 cs.CL

Comments 15 pages, 8 figures

2304.07919 2023-06-21 cs.CV cs.AI 83%

Chain of Thought Prompt Tuning in Vision Language Models

Jiaxin Ge, Hongyin Luo, Siyuan Qian, Yulu Gan, Jie Fu, Shanghang Zhang

专题命中指令微调：language model(title,abstract)；prompting(abstract)；分类 cs.AI

2305.04790 2023-06-14 cs.CV cs.CL 83%

MultiModal-GPT: A Vision and Language Model for Dialogue with Humans

Tao Gong, Chengqi Lyu, Shilong Zhang, Yudong Wang, Miao Zheng, Qian Zhao, Kuikun Liu, Wenwei Zhang, Ping Luo, Kai Chen

专题命中指令微调：language model(title,abstract)；instruction tuning(abstract)；分类 cs.CL

Comments 10 pages, 8 figures

2212.10773 2023-06-13 cs.CL 83%

MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning

Zhiyang Xu, Ying Shen, Lifu Huang

专题命中指令微调：instruction tuning(title,abstract)；language model(abstract)；分类 cs.CL

Comments ACL 2023, dataset url: https://github.com/VT-NLP/MultiInstruct

2306.03055 2023-06-06 cs.CL 83%

Analyzing Syntactic Generalization Capacity of Pre-trained Language Models on Japanese Honorific Conversion

Ryo Sekizawa, Hitomi Yanaka

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.CL

Comments To appear in the Proceedings of the 12th Joint Conference on Lexical and Computational Semantics (*SEM2023) with ACL2023

2305.19500 2023-06-01 cs.CL 83%

Exploring Lottery Prompts for Pre-trained Language Models

Yulin Chen, Ning Ding, Xiaobin Wang, Shengding Hu, Hai-Tao Zheng, Zhiyuan Liu, Pengjun Xie

专题命中指令微调：language model(title,abstract)；prompting(abstract)；分类 cs.CL

Comments Accepted to ACL 2023

2305.11952 2023-05-23 cs.CL 83%

Self-QA: Unsupervised Knowledge Guided Language Model Alignment

Xuanyu Zhang, Qing Yang

专题命中指令微调：language model(title,abstract)；instruction tuning(abstract)；分类 cs.CL

2304.10977 2023-04-24 cs.CL stat.ML 83%

Evaluating Transformer Language Models on Arithmetic Operations Using Number Decomposition

Matteo Muffo, Aldo Cocco, Enrico Bertino

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.CL

Comments 7 pages, 1 figure, published at LREC 2022

Journal ref Proceedings of the 13th Conference on Language Resources and Evaluation (LREC 2022), pages 291-297

2304.06248 2023-04-14 cs.CL 83%

LasUIE: Unifying Information Extraction with Latent Adaptive Structure-aware Generative Language Model

Hao Fei, Shengqiong Wu, Jingye Li, Bobo Li, Fei Li, Libo Qin, Meishan Zhang, Min Zhang, Tat-Seng Chua

专题命中指令微调：language model(title,abstract)；post-training(abstract)；分类 cs.CL

Comments NeurIPS2022 conference paper

2204.07841 2023-03-28 cs.CV cs.AI cs.MM 83%

Multi-Modal Few-Shot Object Detection with Meta-Learning-Based Cross-Modal Prompting

Guangxing Han, Long Chen, Jiawei Ma, Shiyuan Huang, Rama Chellappa, Shih-Fu Chang

专题命中指令微调：prompting(title,abstract)；language model(abstract)；分类 cs.AI

Comments 17 pages

2302.10879 2023-02-22 cs.CL 83%

$k$NN-Adapter: Efficient Domain Adaptation for Black-Box Language Models

Yangsibo Huang, Daogao Liu, Zexuan Zhong, Weijia Shi, Yin Tat Lee

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.CL

2301.12066 2023-01-31 cs.CY cs.AI 83%

Truth Machines: Synthesizing Veracity in AI Language Models

Luke Munn, Liam Magee, Vanicka Arora

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.AI

Comments 20 pages, 3 figures

2210.13669 2022-10-26 cs.CL 83%

Help me write a poem: Instruction Tuning as a Vehicle for Collaborative Poetry Writing

Tuhin Chakrabarty, Vishakh Padmakumar, He He

专题命中指令微调：instruction tuning(title)；large language model(abstract)；language model(abstract)；分类 cs.CL

Comments To appear at EMNLP 2022

2209.11068 2022-09-23 cs.CL 83%

Prompting for a conversation: How to control a dialog model?

Josef Valvoda, Yimai Fang, David Vandyke

专题命中指令微调：prompting(title,abstract)；language model(abstract)；分类 cs.CL

2209.02128 2022-09-07 cs.CL 83%

Evaluating the Susceptibility of Pre-Trained Language Models via Handcrafted Adversarial Examples

Hezekiah J. Branch, Jonathan Rodriguez Cefalu, Jeremy McHugh, Leyla Hujer, Aditya Bahl, Daniel del Castillo Iglesias, Ron Heichman, Ramesh Darwishi

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.CL

Comments 10 pages, 1 figure, 3 tables

2206.06336 2022-06-14 cs.CL 83%

Language Models are General-Purpose Interfaces

Yaru Hao, Haoyu Song, Li Dong, Shaohan Huang, Zewen Chi, Wenhui Wang, Shuming Ma, Furu Wei

专题命中指令微调：language model(title,abstract)；foundation model(abstract)；分类 cs.CL

Comments 32 pages. The first three authors contribute equally

1. 指令微调 11619 篇

Diversifying Knowledge Enhancement of Biomedical Language Models using Adapter Modules and Knowledge Graphs

Parameter-Efficient Fine-Tuning Methods for Pretrained Language Models: A Critical Review and Assessment

SPT: Fine-Tuning Transformer-based Language Models Efficiently with Sparsification

What Do Llamas Really Think? Revealing Preference Biases in Language Model Representations

Frugal Prompting for Dialog Models

GPCR-BERT: Interpreting Sequential Design of G Protein Coupled Receptors Using Protein Language Models

Meta-Learning Online Adaptation of Language Models

PIEClass: Weakly-Supervised Text Classification with Prompting and Noise-Robust Iterative Ensemble Training

Using Global Land Cover Product as Prompt for Cropland Mapping via Visual Foundation Model

SALM: Speech-augmented Language Model with In-context Learning for Speech Recognition and Translation

Don't Stop Pretraining? Make Prompt-based Fine-tuning Powerful Learner

Fine-tune Language Models to Approximate Unbiased In-context Learning

TransPrompt v2: A Transferable Prompting Framework for Cross-task Text Classification

Towards a Visual-Language Foundation Model for Computational Pathology

ChatSpot: Bootstrapping Multimodal LLMs via Precise Referring Instruction Tuning

Chain of Thought Prompt Tuning in Vision Language Models

MultiModal-GPT: A Vision and Language Model for Dialogue with Humans

MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning

Analyzing Syntactic Generalization Capacity of Pre-trained Language Models on Japanese Honorific Conversion

Exploring Lottery Prompts for Pre-trained Language Models

Self-QA: Unsupervised Knowledge Guided Language Model Alignment

Evaluating Transformer Language Models on Arithmetic Operations Using Number Decomposition

LasUIE: Unifying Information Extraction with Latent Adaptive Structure-aware Generative Language Model

Multi-Modal Few-Shot Object Detection with Meta-Learning-Based Cross-Modal Prompting

$k$NN-Adapter: Efficient Domain Adaptation for Black-Box Language Models

Truth Machines: Synthesizing Veracity in AI Language Models

Help me write a poem: Instruction Tuning as a Vehicle for Collaborative Poetry Writing

Prompting for a conversation: How to control a dialog model?

Evaluating the Susceptibility of Pre-Trained Language Models via Handcrafted Adversarial Examples

Language Models are General-Purpose Interfaces