语言大模型 / LLM - arXivDaily 专题

2403.12374 2024-03-20 cs.CL 89%

Improving Generalizability of Extracting Social Determinants of Health Using Large Language Models through Prompt-tuning

Cheng Peng, Zehao Yu, Kaleb E Smith, Wei-Hsuan Lo-Ciganic, Jiang Bian, Yonghui Wu

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2403.11435 2024-03-19 cs.CL 89%

InsCL: A Data-efficient Continual Learning Paradigm for Fine-tuning Large Language Models with Instructions

Yifan Wang, Yafei Liu, Chufan Shi, Haoling Li, Chen Chen, Haonan Lu, Yujiu Yang

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；instruction tuning(abstract)；分类 cs.CL

Comments Accepted by NAACL 2024

2403.07581 2024-03-13 cs.CL 89%

LLMvsSmall Model? Large Language Model Based Text Augmentation Enhanced Personality Detection Model

Linmei Hu, Hongyu He, Duokang Wang, Ziwang Zhao, Yingxia Shao, Liqiang Nie

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2403.00338 2024-03-04 cs.CL 89%

Semi-Instruct: Bridging Natural-Instruct and Self-Instruct for Code Large Language Models

Xianzhen Luo, Qingfu Zhu, Zhiming Zhang, Xu Wang, Qing Yang, Dongliang Xu, Wanxiang Che

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；instruction tuning(abstract)；分类 cs.CL

2402.13064 2024-02-21 cs.CL 89%

Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models

Haoran Li, Qingxiu Dong, Zhengyang Tang, Chaojun Wang, Xingxing Zhang, Haoyang Huang, Shaohan Huang, Xiaolong Huang, Zeqiang Huang, Dongdong Zhang, Yuxian Gu, Xin Cheng, Xun Wang, Si-Qing Chen, Li Dong, Wei Lu, Zhifang Sui, Benyou Wang, Wai Lam, Furu Wei

专题命中指令微调：language model(title,abstract)；instruction tuning(title,abstract)；large language model(abstract)；分类 cs.CL

Comments Work in progress

2402.13036 2024-02-21 cs.CL 89%

SiLLM: Large Language Models for Simultaneous Machine Translation

Shoutao Guo, Shaolei Zhang, Zhengrui Ma, Min Zhang, Yang Feng

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 13 pages, 6 tables, 7 figures

2402.12851 2024-02-21 cs.CL 89%

MoELoRA: Contrastive Learning Guided Mixture of Experts on Parameter-Efficient Fine-Tuning for Large Language Models

Tongxu Luo, Jiahe Lei, Fangyu Lei, Weihao Liu, Shizhu He, Jun Zhao, Kang Liu

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2402.12501 2024-02-21 cs.CL 89%

Your Vision-Language Model Itself Is a Strong Filter: Towards High-Quality Instruction Tuning with Data Selection

Ruibo Chen, Yihan Wu, Lichang Chen, Guodong Liu, Qi He, Tianyi Xiong, Chenxi Liu, Junfeng Guo, Heng Huang

专题命中指令微调：language model(title,abstract)；instruction tuning(title,abstract)；large language model(abstract)；分类 cs.CL

Comments 9 pages, 3 figures, 4 tables

2402.12048 2024-02-20 cs.CL 89%

Model Tailor: Mitigating Catastrophic Forgetting in Multi-modal Large Language Models

Didi Zhu, Zhongyi Sun, Zexi Li, Tao Shen, Ke Yan, Shouhong Ding, Kun Kuang, Chao Wu

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；post-training(abstract)；分类 cs.CL

2309.11674 2024-02-07 cs.CL 89%

A Paradigm Shift in Machine Translation: Boosting Translation Performance of Large Language Models

Haoran Xu, Young Jin Kim, Amr Sharaf, Hany Hassan Awadalla

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted at ICLR 2024

2401.07031 2024-02-01 cs.CR cs.AI cs.SE 89%

Code Security Vulnerability Repair Using Reinforcement Learning with Large Language Models

Nafis Tanveer Islam, Mohammad Bahrami Karkevandi, Peyman Najafirad

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2312.00949 2024-02-01 cs.CL math.OC 89%

Hyperparameter Optimization for Large Language Model Instruction-Tuning

Christophe Tribes, Sacha Benarroch-Lelong, Peng Lu, Ivan Kobyzev

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2401.12379 2024-01-24 cs.AI cs.DB cs.PL 89%

Analyzing the Effectiveness of Large Language Models on Text-to-SQL Synthesis

Richard Roberson, Gowtham Kaki, Ashutosh Trivedi

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2307.04408 2024-01-23 cs.CL 89%

TIM: Teaching Large Language Models to Translate with Comparison

Jiali Zeng, Fandong Meng, Yongjing Yin, Jie Zhou

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；instruction tuning(abstract)；分类 cs.CL

Comments AAAI 2024

2310.11374 2024-01-18 cs.CL 89%

DialogueLLM: Context and Emotion Knowledge-Tuned Large Language Models for Emotion Recognition in Conversations

Yazhou Zhang, Mengyao Wang, Youxi Wu, Prayag Tiwari, Qiuchi Li, Benyou Wang, Jing Qin

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2311.16989 2024-01-17 cs.CL 89%

ChatGPT's One-year Anniversary: Are Open-Source Large Language Models Catching up?

Hailin Chen, Fangkai Jiao, Xingxuan Li, Chengwei Qin, Mathieu Ravaut, Ruochen Zhao, Caiming Xiong, Shafiq Joty

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments version v4, included latest top-performing open-sourced LLMs

2312.15696 2023-12-27 cs.CL 89%

EcomGPT-CT: Continual Pre-training of E-commerce Large Language Models with Semi-structured Data

Shirong Ma, Shen Huang, Shulin Huang, Xiaobin Wang, Yangning Li, Hai-Tao Zheng, Pengjun Xie, Fei Huang, Yong Jiang

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；instruction tuning(abstract)；分类 cs.CL

2312.12740 2023-12-21 cs.CL cs.IR 89%

Fine-tuning Large Language Models for Adaptive Machine Translation

Yasmin Moslem, Rejwanul Haque, Andy Way

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2309.07544 2023-12-12 cs.LG cs.SE 89%

VerilogEval: Evaluating Large Language Models for Verilog Code Generation

Mingjie Liu, Nathaniel Pinckney, Brucek Khailany, Haoxing Ren

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

Comments ICCAD 2023 Invited Paper. Prior version contained errors in the numbers reported for gpt-4 in Table II

2311.17126 2023-11-30 cs.CV cs.CL 89%

Reason out Your Layout: Evoking the Layout Master from Large Language Models for Text-to-Image Synthesis

Xiaohui Chen, Yongfei Liu, Yingxiang Yang, Jianbo Yuan, Quanzeng You, Li-Ping Liu, Hongxia Yang

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

Comments preprint

2311.14332 2023-11-27 cs.LG stat.ML 89%

GATGPT: A Pre-trained Large Language Model with Graph Attention Network for Spatiotemporal Imputation

Yakun Chen, Xianzhi Wang, Guandong Xu

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

2307.03817 2023-11-23 cs.SE cs.AI 89%

Exploring and Characterizing Large Language Models For Embedded System Development and Debugging

Zachary Englhardt, Richard Li, Dilini Nissanka, Zhihan Zhang, Girish Narayanswamy, Joseph Breda, Xin Liu, Shwetak Patel, Vikram Iyer

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2305.18098 2023-11-22 cs.CL 89%

BigTranslate: Augmenting Large Language Models with Multilingual Translation Capability over 100 Languages

Wen Yang, Chong Li, Jiajun Zhang, Chengqing Zong

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；foundation model(abstract)；分类 cs.CL

Comments 16 pages, 4 figures. Our model is available at https://github.com/ZNLP/BigTranslate

2305.14489 2023-11-16 cs.CL 89%

Are Large Language Models Robust Coreference Resolvers?

Nghia T. Le, Alan Ritter

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

2311.05965 2023-11-13 cs.CL 89%

Large Language Models are Zero Shot Hypothesis Proposers

Biqing Qi, Kaiyan Zhang, Haoxiang Li, Kai Tian, Sihang Zeng, Zhang-Ren Chen, Bowen Zhou

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Instruction Workshop @ NeurIPS 2023

2305.14871 2023-11-07 cs.CL 89%

ClusterLLM: Large Language Models as a Guide for Text Clustering

Yuwei Zhang, Zihan Wang, Jingbo Shang

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments EMNLP2023(main)

2310.18233 2023-11-02 cs.AI 89%

Will releasing the weights of future large language models grant widespread access to pandemic agents?

Anjali Gopal, Nathan Helm-Burger, Lennart Justen, Emily H. Soice, Tiffany Tzeng, Geetha Jeyapragasan, Simon Grimm, Benjamin Mueller, Kevin M. Esvelt

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；foundation model(abstract)；分类 cs.AI

Comments Updates in response to online feedback: emphasized the focus on risks from future rather than current models; explained the reasoning behind - and minimal effects of - fine-tuning on virology papers; elaborated on how easier access to synthesized information can reduce barriers to entry; clarified policy recommendations regarding what is necessary but not sufficient; corrected a citation link

2310.17857 2023-10-30 cs.CL 89%

From Values to Opinions: Predicting Human Behaviors and Stances Using Value-Injected Large Language Models

Dongjun Kang, Joonsuk Park, Yohan Jo, JinYeong Bak

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments EMNLP 2023 main paper accepted

2310.17630 2023-10-27 cs.CL 89%

InstOptima: Evolutionary Multi-objective Instruction Optimization via Large Language Model-based Instruction Operators

Heng Yang, Ke Li

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted by EMNLP Findings

2310.15477 2023-10-25 cs.CL 89%

CRaSh: Clustering, Removing, and Sharing Enhance Fine-tuning without Full Large Language Model

Kaiyan Zhang, Ning Ding, Biqing Qi, Xuekai Zhu, Xinwei Long, Bowen Zhou

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；instruction tuning(abstract)；分类 cs.CL

Comments Accepted to EMNLP 2023 (Main Conference)

1. 指令微调 11653 篇

Improving Generalizability of Extracting Social Determinants of Health Using Large Language Models through Prompt-tuning

InsCL: A Data-efficient Continual Learning Paradigm for Fine-tuning Large Language Models with Instructions

LLMvsSmall Model? Large Language Model Based Text Augmentation Enhanced Personality Detection Model

Semi-Instruct: Bridging Natural-Instruct and Self-Instruct for Code Large Language Models

Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models

SiLLM: Large Language Models for Simultaneous Machine Translation

MoELoRA: Contrastive Learning Guided Mixture of Experts on Parameter-Efficient Fine-Tuning for Large Language Models

Your Vision-Language Model Itself Is a Strong Filter: Towards High-Quality Instruction Tuning with Data Selection

Model Tailor: Mitigating Catastrophic Forgetting in Multi-modal Large Language Models

A Paradigm Shift in Machine Translation: Boosting Translation Performance of Large Language Models

Code Security Vulnerability Repair Using Reinforcement Learning with Large Language Models

Hyperparameter Optimization for Large Language Model Instruction-Tuning

Analyzing the Effectiveness of Large Language Models on Text-to-SQL Synthesis

TIM: Teaching Large Language Models to Translate with Comparison

DialogueLLM: Context and Emotion Knowledge-Tuned Large Language Models for Emotion Recognition in Conversations

ChatGPT's One-year Anniversary: Are Open-Source Large Language Models Catching up?

EcomGPT-CT: Continual Pre-training of E-commerce Large Language Models with Semi-structured Data

Fine-tuning Large Language Models for Adaptive Machine Translation

VerilogEval: Evaluating Large Language Models for Verilog Code Generation

Reason out Your Layout: Evoking the Layout Master from Large Language Models for Text-to-Image Synthesis

GATGPT: A Pre-trained Large Language Model with Graph Attention Network for Spatiotemporal Imputation

Exploring and Characterizing Large Language Models For Embedded System Development and Debugging

BigTranslate: Augmenting Large Language Models with Multilingual Translation Capability over 100 Languages

Are Large Language Models Robust Coreference Resolvers?

Large Language Models are Zero Shot Hypothesis Proposers

ClusterLLM: Large Language Models as a Guide for Text Clustering

Will releasing the weights of future large language models grant widespread access to pandemic agents?

From Values to Opinions: Predicting Human Behaviors and Stances Using Value-Injected Large Language Models

InstOptima: Evolutionary Multi-objective Instruction Optimization via Large Language Model-based Instruction Operators

CRaSh: Clustering, Removing, and Sharing Enhance Fine-tuning without Full Large Language Model