语言大模型 / LLM - arXivDaily 专题

2404.15206 2024-10-04 cs.CL 83%

Does Instruction Tuning Make LLMs More Consistent?

Constanza Fierro, Jiaang Li, Anders Søgaard

专题命中指令微调：instruction tuning(title,abstract)；language model(abstract)；分类 cs.CL

Comments We need to run extra experiments to ensure some of the claims in the paper are fully correct

2409.19611 2024-10-01 cs.CL 83%

Learning Attentional Mixture of LoRAs for Language Model Continual Learning

Jialin Liu, Jianhua Wu, Jie Liu, Yutai Duan

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.CL

Comments 12 pages, 5 figures

2409.14759 2024-09-24 cs.CV cs.AI 83%

VLM's Eye Examination: Instruct and Inspect Visual Competency of Vision Language Models

Nam Hyeon-Woo, Moon Ye-Bin, Wonseok Choi, Lee Hyun, Tae-Hyun Oh

专题命中指令微调：language model(title,abstract)；LLM(abstract)；分类 cs.AI

2409.14254 2024-09-24 cs.CL 83%

Instruction Following without Instruction Tuning

John Hewitt, Nelson F. Liu, Percy Liang, Christopher D. Manning

专题命中指令微调：instruction tuning(title,abstract)；language model(abstract)；分类 cs.CL

2404.03028 2024-08-30 cs.CL 83%

An Incomplete Loop: Instruction Inference, Instruction Following, and In-context Learning in Language Models

Emmy Liu, Graham Neubig, Jacob Andreas

专题命中指令微调：language model(title,abstract)；prompting(abstract)；分类 cs.CL

Comments COLM 2024

2408.00690 2024-08-05 cs.CL 83%

Improving Text Embeddings for Smaller Language Models Using Contrastive Fine-tuning

Trapoom Ukarapol, Zhicheng Lee, Amy Xin

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.CL

Comments Code: https://github.com/trapoom555/Language-Model-STS-CFT, Huggingface: https://huggingface.co/collections/trapoom555/small-lms-text-embedding-663b3ec87527788a577f6852

2310.01651 2024-08-05 cs.LG 83%

Fool Your (Vision and) Language Model With Embarrassingly Simple Permutations

Yongshuo Zong, Tingyang Yu, Ruchika Chavhan, Bingchen Zhao, Timothy Hospedales

专题命中指令微调：language model(title,abstract)；prompting(abstract)；分类 cs.LG

Comments ICML 2024; v3 fix typo

2407.21417 2024-08-01 cs.CL 83%

Dancing in Chains: Reconciling Instruction Following and Faithfulness in Language Models

Zhengxuan Wu, Yuhao Zhang, Peng Qi, Yumo Xu, Rujun Han, Yian Zhang, Jifan Chen, Bonan Min, Zhiheng Huang

专题命中指令微调：language model(title,abstract)；instruction tuning(abstract)；分类 cs.CL

Comments preprint

2407.12790 2024-07-19 cs.CL 83%

GPT Czech Poet: Generation of Czech Poetic Strophes with Language Models

Michal Chudoba, Rudolf Rosa

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.CL

2303.05759 2024-07-18 cs.CL 83%

An Overview on Language Models: Recent Developments and Outlook

Chengwei Wei, Yun-Cheng Wang, Bin Wang, C. -C. Jay Kuo

专题命中指令微调：language model(title,abstract)；foundation model(abstract)；分类 cs.CL

2407.07577 2024-07-11 cs.CV cs.AI 83%

IDA-VLM: Towards Movie Understanding via ID-Aware Large Vision-Language Model

Yatai Ji, Shilong Zhang, Jie Wu, Peize Sun, Weifeng Chen, Xuefeng Xiao, Sidi Yang, Yujiu Yang, Ping Luo

专题命中指令微调：language model(title,abstract)；instruction tuning(abstract)；分类 cs.AI

2406.13235 2024-06-21 cs.IR cs.AI 83%

Enhancing Collaborative Semantics of Language Model-Driven Recommendations via Graph-Aware Learning

Zhong Guan, Likang Wu, Hongke Zhao, Ming He, Jianpin Fan

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.AI

Comments 10pages

2406.11256 2024-06-18 cs.CL 83%

Dynamic Data Mixing Maximizes Instruction Tuning for Mixture-of-Experts

Tong Zhu, Daize Dong, Xiaoye Qu, Jiacheng Ruan, Wenliang Chen, Yu Cheng

专题命中指令微调：instruction tuning(title,abstract)；SFT(abstract)；分类 cs.CL

2406.09994 2024-06-17 cs.CL 83%

Precision Empowers, Excess Distracts: Visual Question Answering With Dynamically Infused Knowledge In Language Models

Manas Jhalani, Annervaz K M, Pushpak Bhattacharyya

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.CL

Comments 16 pages, 12 figures

2306.11825 2024-06-10 cs.CL 83%

DiNADO: Norm-Disentangled Neurally-Decomposed Oracles for Controlling Language Models

Sidi Lu, Wenbo Zhao, Chenyang Tao, Arpit Gupta, Shanchan Wu, Tagyoung Chung, Nanyun Peng

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.CL

Comments Accepted to ICML 2024 (Poster). Work was done during an Amazon Internship Program

2310.09639 2024-06-07 cs.LG cs.CR math.OC stat.ML 83%

DPZero: Private Fine-Tuning of Language Models without Backpropagation

Liang Zhang, Bingcong Li, Kiran Koshy Thekumparampil, Sewoong Oh, Niao He

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.LG

Comments ICML 2024

2402.02347 2024-06-06 cs.LG cs.NA math.NA math.OC 83%

Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models

Fangzhao Zhang, Mert Pilanci

专题命中指令微调：foundation model(title)；large language model(abstract)；language model(abstract)；分类 cs.LG

2405.20348 2024-06-03 physics.ao-ph cs.LG 83%

Personalized Adapter for Large Meteorology Model on Devices: Towards Weather Foundation Models

Shengchao Chen, Guodong Long, Jing Jiang, Chengqi Zhang

专题命中指令微调：foundation model(title,abstract)；language model(abstract)；分类 cs.LG

Comments 42 pages, under review

2402.13669 2024-05-29 cs.CL 83%

Self-Distillation Bridges Distribution Gap in Language Model Fine-Tuning

Zhaorui Yang, Tianyu Pang, Haozhe Feng, Han Wang, Wei Chen, Minfeng Zhu, Qian Liu

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.CL

Comments ACL 2024

2405.14231 2024-05-24 cs.CL 83%

From Role-Play to Drama-Interaction: An LLM Solution

Weiqi Wu, Hongqiu Wu, Lai Jiang, Xingyuan Liu, Jiale Hong, Hai Zhao, Min Zhang

专题命中指令微调：LLM(title,abstract)；instruction tuning(abstract)；分类 cs.CL

Comments Accepted by ACL 2024 Findings

2404.17216 2024-04-29 cs.CL 83%

Prompting Towards Alleviating Code-Switched Data Scarcity in Under-Resourced Languages with GPT as a Pivot

Michelle Terblanche, Kayode Olaleye, Vukosi Marivate

专题命中指令微调：prompting(title,abstract)；language model(abstract)；分类 cs.CL

Comments To be published in the Proceedings of SIGUL 2024: 3rd Annual Meeting of the Special Interest Group on Under-resourced Languages

2403.02932 2024-04-26 cs.CL 83%

RulePrompt: Weakly Supervised Text Classification with Prompting PLMs and Self-Iterative Logical Rules

Miaomiao Li, Jiaqi Zhu, Yang Wang, Yi Yang, Yilin Li, Hongan Wang

专题命中指令微调：prompting(title,abstract)；language model(abstract)；分类 cs.CL

Comments Accepted by WWW 2024

2311.08590 2024-04-01 cs.CL 83%

PEMA: An Offsite-Tunable Plug-in External Memory Adaptation for Language Models

HyunJin Kim, Young Jin Kim, JinYeong Bak

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.CL

Comments Accepted to NAACL 2024

2401.13923 2024-03-19 cs.LG cs.IR q-bio.BM 83%

Towards 3D Molecule-Text Interpretation in Language Models

Sihang Li, Zhiyuan Liu, Yanchen Luo, Xiang Wang, Xiangnan He, Kenji Kawaguchi, Tat-Seng Chua, Qi Tian

专题命中指令微调：language model(title,abstract)；instruction tuning(abstract)；分类 cs.LG

2403.09028 2024-03-15 cs.CL 83%

ChartInstruct: Instruction Tuning for Chart Comprehension and Reasoning

Ahmed Masry, Mehrad Shahmohammadi, Md Rizwan Parvez, Enamul Hoque, Shafiq Joty

专题命中指令微调：instruction tuning(title,abstract)；LLM(abstract)；分类 cs.CL

2310.08873 2024-03-14 cs.RO cs.AI 83%

Interactive Navigation in Environments with Traversable Obstacles Using Large Language and Vision-Language Models

Zhen Zhang, Anran Lin, Chun Wai Wong, Xiangyu Chu, Qi Dou, K. W. Samuel Au

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.AI

Comments Accepted by 2024 IEEE International Conference on Robotics and Automation (ICRA), 7 pages, 8 figures

2403.06857 2024-03-12 cs.CL 83%

Development of a Reliable and Accessible Caregiving Language Model (CaLM)

Bambang Parmanto, Bayu Aryoyudanta, Wilbert Soekinto, I Made Agus Setiawan, Yuhan Wang, Haomin Hu, Andi Saptono, Yong K. Choi

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.CL

2403.02677 2024-03-06 cs.CV cs.CL 83%

Finetuned Multimodal Language Models Are High-Quality Image-Text Data Filters

Weizhi Wang, Khalil Mrini, Linjie Yang, Sateesh Kumar, Yu Tian, Xifeng Yan, Heng Wang

专题命中指令微调：language model(title,abstract)；foundation model(abstract)；分类 cs.CL

Comments Project Website: https://mlm-filter.github.io

2402.15930 2024-02-27 cs.CL 83%

Evaluating Prompting Strategies for Grammatical Error Correction Based on Language Proficiency

Min Zeng, Jiexin Kuang, Mengyang Qiu, Jayoung Song, Jungyeul Park

专题命中指令微调：prompting(title,abstract)；LLM(abstract)；分类 cs.CL

Comments To appear in LREC-COLING 2024, short paper (preprint)

2402.04489 2024-02-08 cs.LG cs.CR cs.CY stat.ME 83%

De-amplifying Bias from Differential Privacy in Language Model Fine-tuning

Sanjari Srivastava, Piotr Mardziel, Zhikhun Zhang, Archana Ahlawat, Anupam Datta, John C Mitchell

专题命中指令微调：language model(title,abstract)；large language model(abstract)；分类 cs.LG

1. 指令微调 11619 篇

Does Instruction Tuning Make LLMs More Consistent?

Learning Attentional Mixture of LoRAs for Language Model Continual Learning

VLM's Eye Examination: Instruct and Inspect Visual Competency of Vision Language Models

Instruction Following without Instruction Tuning

An Incomplete Loop: Instruction Inference, Instruction Following, and In-context Learning in Language Models

Improving Text Embeddings for Smaller Language Models Using Contrastive Fine-tuning

Fool Your (Vision and) Language Model With Embarrassingly Simple Permutations

Dancing in Chains: Reconciling Instruction Following and Faithfulness in Language Models

GPT Czech Poet: Generation of Czech Poetic Strophes with Language Models

An Overview on Language Models: Recent Developments and Outlook

IDA-VLM: Towards Movie Understanding via ID-Aware Large Vision-Language Model

Enhancing Collaborative Semantics of Language Model-Driven Recommendations via Graph-Aware Learning

Dynamic Data Mixing Maximizes Instruction Tuning for Mixture-of-Experts

Precision Empowers, Excess Distracts: Visual Question Answering With Dynamically Infused Knowledge In Language Models

DiNADO: Norm-Disentangled Neurally-Decomposed Oracles for Controlling Language Models

DPZero: Private Fine-Tuning of Language Models without Backpropagation

Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models

Personalized Adapter for Large Meteorology Model on Devices: Towards Weather Foundation Models

Self-Distillation Bridges Distribution Gap in Language Model Fine-Tuning

From Role-Play to Drama-Interaction: An LLM Solution

Prompting Towards Alleviating Code-Switched Data Scarcity in Under-Resourced Languages with GPT as a Pivot

RulePrompt: Weakly Supervised Text Classification with Prompting PLMs and Self-Iterative Logical Rules

PEMA: An Offsite-Tunable Plug-in External Memory Adaptation for Language Models

Towards 3D Molecule-Text Interpretation in Language Models

ChartInstruct: Instruction Tuning for Chart Comprehension and Reasoning

Interactive Navigation in Environments with Traversable Obstacles Using Large Language and Vision-Language Models

Development of a Reliable and Accessible Caregiving Language Model (CaLM)

Finetuned Multimodal Language Models Are High-Quality Image-Text Data Filters

Evaluating Prompting Strategies for Grammatical Error Correction Based on Language Proficiency

De-amplifying Bias from Differential Privacy in Language Model Fine-tuning