语言大模型 / LLM - arXivDaily 专题

2408.08027 2024-10-14 eess.AS cs.CL cs.SD 89%

Enhancing Large Language Model-based Speech Recognition by Contextualization for Rare and Ambiguous Words

Kento Nozawa, Takashi Masuko, Toru Taniguchi

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 13 pages, 1 figure, and 7 tables

2410.07652 2024-10-11 cs.CL 89%

StablePrompt: Automatic Prompt Tuning using Reinforcement Learning for Large Language Models

Minchan Kwon, Gaeun Kim, Jongsuk Kim, Haeil Lee, Junmo Kim

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments EMNLP 2024 cam-ready

2410.06338 2024-10-10 cs.CL 89%

Are Large Language Models State-of-the-art Quality Estimators for Machine Translation of User-generated Content?

Shenbin Qian, Constantin Orăsan, Diptesh Kanojia, Félix do Carmo

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2410.05802 2024-10-10 cs.CL 89%

Gradual Learning: Optimizing Fine-Tuning with Partially Mastered Knowledge in Large Language Models

Bozhou Li, Hao Liang, Yang Li, Fangcheng Fu, Hongzhi Yin, Conghui He, Wentao Zhang

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；pretraining(abstract)；分类 cs.CL

2410.05608 2024-10-10 cs.CL 89%

Multimodal Large Language Models and Tunings: Vision, Language, Sensors, Audio, and Beyond

Soyeon Caren Han, Feiqi Cao, Josiah Poon, Roberto Navigli

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；instruction tuning(abstract)；分类 cs.CL

Comments Accepted at ACM-MM 2024

2410.05559 2024-10-10 cs.CL 89%

Attribute Controlled Fine-tuning for Large Language Models: A Case Study on Detoxification

Tao Meng, Ninareh Mehrabi, Palash Goyal, Anil Ramakrishna, Aram Galstyan, Richard Zemel, Kai-Wei Chang, Rahul Gupta, Charith Peris

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted to EMNLP Findings

2406.08811 2024-10-08 cs.CL 89%

Mixture-of-Skills: Learning to Optimize Data Usage for Fine-Tuning Large Language Models

Minghao Wu, Thuy-Trang Vu, Lizhen Qu, Gholamreza Haffari

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 15 pages, 7 tables, 4 figures; Accepted by EMNLP2024 main

2402.05000 2024-10-08 cs.CL 89%

Pedagogical Alignment of Large Language Models

Shashank Sonkar, Kangqi Ni, Sapana Chaudhary, Richard G. Baraniuk

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；SFT(abstract)；分类 cs.CL

Comments Accepted at EMNLP 2024 Findings Track

2404.14122 2024-10-07 cs.CL 89%

Fine-Tuning Large Language Models to Translate: Will a Touch of Noisy Data in Misaligned Languages Suffice?

Dawei Zhu, Pinzhen Chen, Miaoran Zhang, Barry Haddow, Xiaoyu Shen, Dietrich Klakow

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments EMNLP 2024 Main

2410.02631 2024-10-04 cs.CL 89%

Large Language Model for Multi-Domain Translation: Benchmarking and Domain CoT Fine-tuning

Tianxiang Hu, Pei Zhang, Baosong Yang, Jun Xie, Derek F. Wong, Rui Wang

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2406.14208 2024-09-27 cs.AI 89%

SeCoKD: Aligning Large Language Models for In-Context Learning with Fewer Shots

Weixing Wang, Haojin Yang, Christoph Meinel

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；SFT(abstract)；分类 cs.AI

Comments preprint

2409.13202 2024-09-24 cs.CL 89%

CITI: Enhancing Tool Utilizing Ability in Large Language Models without Sacrificing General Performance

Yupu Hao, Pengfei Cao, Zhuoran Jin, Huanxuan Liao, Yubo Chen, Kang Liu, Jun Zhao

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2409.05732 2024-09-10 cs.CL 89%

Towards Democratizing Multilingual Large Language Models For Medicine Through A Two-Stage Instruction Fine-tuning Approach

Meng Zhou, Surajsinh Parmar, Anubhav Bhatti

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；pretraining(abstract)；分类 cs.CL

Comments Technical Report v1, work in progress

2409.01944 2024-09-04 cs.CL 89%

FuzzCoder: Byte-level Fuzzing Test via Large Language Model

Liqun Yang, Jian Yang, Chaoren Wei, Guanglin Niu, Ge Zhang, Yunli Wang, Linzheng ChaI, Wanxu Xia, Hongcheng Guo, Shun Zhang, Jiaheng Liu, Yuwei Yin, Junran Peng, Jiaxin Ma, Liang Sun, Zhoujun Li

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 11 pages

2404.11288 2024-08-30 cs.CL 89%

A Preference-driven Paradigm for Enhanced Translation with Large Language Models

Dawei Zhu, Sony Trenous, Xiaoyu Shen, Dietrich Klakow, Bill Byrne, Eva Hasler

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；SFT(abstract)；分类 cs.CL

Comments Accepted to NAACL 2024 (long, main)

2408.11061 2024-08-22 cs.CL 89%

StructuredRAG: JSON Response Formatting with Large Language Models

Connor Shorten, Charles Pierse, Thomas Benjamin Smith, Erika Cardenas, Akanksha Sharma, John Trengrove, Bob van Luijt

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL

Comments Preprint. 10 pages, 6 figures

2408.10715 2024-08-21 cs.AI 89%

Fine-Tuning a Local LLaMA-3 Large Language Model for Automated Privacy-Preserving Physician Letter Generation in Radiation Oncology

Yihao Hou, Christoph Bert, Ahmed Gomaa, Godehard Lahmer, Daniel Hoefler, Thomas Weissmann, Raphaela Voigt, Philipp Schubert, Charlotte Schmitter, Alina Depardon, Sabine Semrau, Andreas Maier, Rainer Fietkau, Yixing Huang, Florian Putz

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI

2408.06574 2024-08-14 cs.CL 89%

SparkRA: A Retrieval-Augmented Knowledge Service System Based on Spark Large Language Model

Dayong Wu, Jiaqi Li, Baoxin Wang, Honghong Zhao, Siyuan Xue, Yanjie Yang, Zhijun Chang, Rui Zhang, Li Qian, Bo Wang, Shijin Wang, Zhixiong Zhang, Guoping Hu

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2408.03402 2024-08-08 cs.CL cs.IR 89%

ULLME: A Unified Framework for Large Language Model Embeddings with Generation-Augmented Learning

Hieu Man, Nghia Trung Ngo, Franck Dernoncourt, Thien Huu Nguyen

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2408.03092 2024-08-07 cs.CL 89%

Extend Model Merging from Fine-Tuned to Pre-Trained Large Language Models via Weight Disentanglement

Le Yu, Bowen Yu, Haiyang Yu, Fei Huang, Yongbin Li

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments 17 pages

2403.08229 2024-08-07 cs.CL 89%

Boosting Disfluency Detection with Large Language Model as Disfluency Generator

Zhenrong Cheng, Jiayan Guo, Hao Sun, Yan Zhang

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2406.12793 2024-07-31 cs.CL 89%

ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Tools

Team GLM, :, Aohan Zeng, Bin Xu, Bowen Wang, Chenhui Zhang, Da Yin, Dan Zhang, Diego Rojas, Guanyu Feng, Hanlin Zhao, Hanyu Lai, Hao Yu, Hongning Wang, Jiadai Sun, Jiajie Zhang, Jiale Cheng, Jiayi Gui, Jie Tang, Jing Zhang, Jingyu Sun, Juanzi Li, Lei Zhao, Lindong Wu, Lucen Zhong, Mingdao Liu, Minlie Huang, Peng Zhang, Qinkai Zheng, Rui Lu, Shuaiqi Duan, Shudan Zhang, Shulin Cao, Shuxun Yang, Weng Lam Tam, Wenyi Zhao, Xiao Liu, Xiao Xia, Xiaohan Zhang, Xiaotao Gu, Xin Lv, Xinghan Liu, Xinyi Liu, Xinyue Yang, Xixuan Song, Xunkai Zhang, Yifan An, Yifan Xu, Yilin Niu, Yuantao Yang, Yueyan Li, Yushi Bai, Yuxiao Dong, Zehan Qi, Zhaoyu Wang, Zhen Yang, Zhengxiao Du, Zhenyu Hou, Zihan Wang

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；post-training(abstract)；分类 cs.CL

2407.18723 2024-07-29 cs.LG cs.LO 89%

LLASP: Fine-tuning Large Language Models for Answer Set Programming

Erica Coppolillo, Francesco Calimeri, Giuseppe Manco, Simona Perri, Francesco Ricca

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.LG

2407.15415 2024-07-23 cs.CL 89%

LLaST: Improved End-to-end Speech Translation System Leveraged by Large Language Models

Xi Chen, Songyang Zhang, Qibing Bai, Kai Chen, Satoshi Nakamura

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2407.15071 2024-07-23 cs.DB cs.CL 89%

Relational Database Augmented Large Language Model

Zongyue Qin, Chen Luo, Zhengyang Wang, Haoming Jiang, Yizhou Sun

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

2305.14239 2024-07-19 cs.CL 89%

On Learning to Summarize with Large Language Models as References

Yixin Liu, Kejian Shi, Katherine S He, Longtian Ye, Alexander R. Fabbri, Pengfei Liu, Dragomir Radev, Arman Cohan

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments NAACL 2024, GitHub Repo: https://github.com/yixinL7/SumLLM

2404.06138 2024-07-09 cs.CL 89%

Cendol: Open Instruction-tuned Generative Large Language Models for Indonesian Languages

Samuel Cahyawijaya, Holy Lovenia, Fajri Koto, Rifki Afina Putri, Emmanuel Dave, Jhonson Lee, Nuur Shadieq, Wawan Cenggoro, Salsabil Maulana Akbar, Muhammad Ihza Mahendra, Dea Annisayanti Putri, Bryan Wilie, Genta Indra Winata, Alham Fikri Aji, Ayu Purwarianti, Pascale Fung

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；RLHF(abstract)；分类 cs.CL

Comments Cendol models are released under Apache 2.0 license and will be made publicly available soon

2407.03169 2024-07-04 cs.CL cs.SD eess.AS 89%

Investigating Decoder-only Large Language Models for Speech-to-text Translation

Chao-Wei Huang, Hui Lu, Hongyu Gong, Hirofumi Inaguma, Ilia Kulikov, Ruslan Mavlyutov, Sravya Popuri

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments Accepted to Interspeech 2024

2402.13659 2024-07-03 cs.CR cs.CL 89%

Privacy-Preserving Instructions for Aligning Large Language Models

Da Yu, Peter Kairouz, Sewoong Oh, Zheng Xu

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

Comments ICML 2024. Code available at https://github.com/google-research/google-research/tree/master/dp_instructions

2405.11290 2024-07-01 cs.CL 89%

MBIAS: Mitigating Bias in Large Language Models While Retaining Context

Shaina Raza, Ananya Raval, Veronica Chatrath

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL

1. 指令微调 11653 篇

Enhancing Large Language Model-based Speech Recognition by Contextualization for Rare and Ambiguous Words

StablePrompt: Automatic Prompt Tuning using Reinforcement Learning for Large Language Models

Are Large Language Models State-of-the-art Quality Estimators for Machine Translation of User-generated Content?

Gradual Learning: Optimizing Fine-Tuning with Partially Mastered Knowledge in Large Language Models

Multimodal Large Language Models and Tunings: Vision, Language, Sensors, Audio, and Beyond

Attribute Controlled Fine-tuning for Large Language Models: A Case Study on Detoxification

Mixture-of-Skills: Learning to Optimize Data Usage for Fine-Tuning Large Language Models

Pedagogical Alignment of Large Language Models

Fine-Tuning Large Language Models to Translate: Will a Touch of Noisy Data in Misaligned Languages Suffice?

Large Language Model for Multi-Domain Translation: Benchmarking and Domain CoT Fine-tuning

SeCoKD: Aligning Large Language Models for In-Context Learning with Fewer Shots

CITI: Enhancing Tool Utilizing Ability in Large Language Models without Sacrificing General Performance

Towards Democratizing Multilingual Large Language Models For Medicine Through A Two-Stage Instruction Fine-tuning Approach

FuzzCoder: Byte-level Fuzzing Test via Large Language Model

A Preference-driven Paradigm for Enhanced Translation with Large Language Models

StructuredRAG: JSON Response Formatting with Large Language Models

Fine-Tuning a Local LLaMA-3 Large Language Model for Automated Privacy-Preserving Physician Letter Generation in Radiation Oncology

SparkRA: A Retrieval-Augmented Knowledge Service System Based on Spark Large Language Model

ULLME: A Unified Framework for Large Language Model Embeddings with Generation-Augmented Learning

Extend Model Merging from Fine-Tuned to Pre-Trained Large Language Models via Weight Disentanglement

Boosting Disfluency Detection with Large Language Model as Disfluency Generator

ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Tools

LLASP: Fine-tuning Large Language Models for Answer Set Programming

LLaST: Improved End-to-end Speech Translation System Leveraged by Large Language Models

Relational Database Augmented Large Language Model

On Learning to Summarize with Large Language Models as References

Cendol: Open Instruction-tuned Generative Large Language Models for Indonesian Languages

Investigating Decoder-only Large Language Models for Speech-to-text Translation

Privacy-Preserving Instructions for Aligning Large Language Models

MBIAS: Mitigating Bias in Large Language Models While Retaining Context