语言大模型 / LLM - arXivDaily 专题

2402.05147 2024-06-24 cs.LG cs.CL 90%

ApiQ: Finetuning of 2-Bit Quantized Large Language Model

Baohao Liao, Christian Herold, Shahram Khadivi, Christof Monz

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments more benchmarks and new method, block-wise ApiQ. code: https://github.com/BaohaoLiao/ApiQ

2406.13617 2024-06-21 cs.CL cs.AI 90%

Optimizing Psychological Counseling with Instruction-Tuned Large Language Models

Wenjie Li, Tianyu Sun, Kun Qian, Wenhong Wang

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；instruction tuning(abstract)；分类 cs.CL、cs.AI

Comments 9 pages

2311.17647 2024-06-12 cs.CV cs.AI cs.CL 90%

Text as Images: Can Multimodal Large Language Models Follow Printed Instructions in Pixels?

Xiujun Li, Yujie Lu, Zhe Gan, Jianfeng Gao, William Yang Wang, Yejin Choi

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；pretraining(abstract)；分类 cs.CL、cs.AI

Comments Github: https://github.com/VIM-Bench/VIM_TOOL, Model and Data: https://huggingface.co/VIM-Bench

2406.05812 2024-06-11 cs.CL cs.AI 90%

Seventeenth-Century Spanish American Notary Records for Fine-Tuning Spanish Large Language Models

Shraboni Sarker, Ahmad Tamim Hamad, Hulayyil Alshammari, Viviana Grieco, Praveen Rao

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2312.00027 2024-06-11 cs.CR cs.AI cs.CL 90%

Stealthy and Persistent Unalignment on Large Language Models via Backdoor Injections

Yuanpu Cao, Bochuan Cao, Jinghui Chen

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2403.01165 2024-06-07 cs.CL cs.AI 90%

STAR: Constraint LoRA with Dynamic Active Learning for Data-Efficient Fine-Tuning of Large Language Models

Linhai Zhang, Jialong Wu, Deyu Zhou, Guoqiang Xu

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL、cs.AI

Comments Accepted by ACL2024(Findings)

2405.13041 2024-06-06 cs.CL cs.AI 90%

Assessing Political Bias in Large Language Models

Luca Rettenberger, Markus Reischl, Mark Schutera

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2402.02456 2024-06-04 cs.LG cs.CL 90%

tnGPS: Discovering Unknown Tensor Network Structure Search Algorithms via Large Language Models (LLMs)

Junhua Zeng, Chao Li, Zhun Sun, Qibin Zhao, Guoxu Zhou

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL、cs.LG

Comments Accepted by ICML2024, pre-printed version

2405.20512 2024-06-03 cs.CL cs.LG 90%

How Multilingual Are Large Language Models Fine-Tuned for Translation?

Aquia Richburg, Marine Carpuat

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

2402.11505 2024-05-31 cs.CL cs.AI 90%

Federated Fine-tuning of Large Language Models under Heterogeneous Tasks and Client Resources

Jiamu Bai, Daoyuan Chen, Bingchen Qian, Liuyi Yao, Yaliang Li

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments 19 pages, 13 tables, 9 figures

2402.10466 2024-05-31 cs.CL cs.AI 90%

Large Language Models as Zero-shot Dialogue State Tracker through Function Calling

Zekun Li, Zhiyu Zoey Chen, Mike Ross, Patrick Huber, Seungwhan Moon, Zhaojiang Lin, Xin Luna Dong, Adithya Sagar, Xifeng Yan, Paul A. Crook

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL、cs.AI

Comments ACL 2024 Main. Code available at: https://github.com/facebookresearch/FnCTOD

2405.11002 2024-05-21 cs.LG cs.AI cs.CR 90%

Large Language Models in Wireless Application Design: In-Context Learning-enhanced Automatic Network Intrusion Detection

Han Zhang, Akram Bin Sediq, Ali Afana, Melike Erol-Kantarci

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

2401.14192 2024-05-20 cs.LG cs.CL 90%

How Can Large Language Models Understand Spatial-Temporal Data?

Lei Liu, Shuo Yu, Runze Wang, Zhenxun Ma, Yanming Shen

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

2405.06686 2024-05-14 cs.CL cs.AI 90%

Word2World: Generating Stories and Worlds through Large Language Models

Muhammad U. Nasir, Steven James, Julian Togelius

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2309.12342 2024-05-09 cs.CY cs.CL cs.LG 90%

Cultural Alignment in Large Language Models: An Explanatory Analysis Based on Hofstede's Cultural Dimensions

Reem I. Masoud, Ziquan Liu, Martin Ferianc, Philip Treleaven, Miguel Rodrigues

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL、cs.LG

Comments 31 pages

2404.17807 2024-04-30 cs.CL cs.AI 90%

Meta In-Context Learning Makes Large Language Models Better Zero and Few-Shot Relation Extractors

Guozheng Li, Peng Wang, Jiajun Liu, Yikai Guo, Ke Ji, Ziyu Shang, Zijie Xu

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments IJCAI 2024

2402.16846 2024-04-17 cs.CV cs.AI cs.CL 90%

GROUNDHOG: Grounding Large Language Models to Holistic Segmentation

Yichi Zhang, Ziqiao Ma, Xiaofeng Gao, Suhaila Shakiah, Qiaozi Gao, Joyce Chai

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；instruction tuning(abstract)；分类 cs.CL、cs.AI

Comments Accepted to CVPR 2024. Website: https://groundhog-mllm.github.io/

2404.01295 2024-04-02 cs.CL cs.AI 90%

Towards Safety and Helpfulness Balanced Responses via Controllable Large Language Models

Yi-Lin Tuan, Xilun Chen, Eric Michael Smith, Louis Martin, Soumya Batra, Asli Celikyilmaz, William Yang Wang, Daniel M. Bikel

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

2304.14178 2024-04-01 cs.CL cs.CV cs.LG 90%

mPLUG-Owl: Modularization Empowers Large Language Models with Multimodality

Qinghao Ye, Haiyang Xu, Guohai Xu, Jiabo Ye, Ming Yan, Yiyang Zhou, Junyang Wang, Anwen Hu, Pengcheng Shi, Yaya Shi, Chenliang Li, Yuanhong Xu, Hehong Chen, Junfeng Tian, Qi Qian, Ji Zhang, Fei Huang, Jingren Zhou

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.LG

Comments Working in Process

2403.15484 2024-03-26 cs.CL cs.LG 90%

RakutenAI-7B: Extending Large Language Models for Japanese

Rakuten Group, Aaron Levine, Connie Huang, Chenguang Wang, Eduardo Batista, Ewa Szymanska, Hongyi Ding, Hou Wei Chou, Jean-François Pessiot, Johanes Effendi, Justin Chiu, Kai Torben Ohlhus, Karan Chopra, Keiji Shinzato, Koji Murakami, Lee Xiong, Lei Chen, Maki Kubota, Maksim Tkachenko, Miroku Lee, Naoki Takahashi, Prathyusha Jwalapuram, Ryutaro Tatsushima, Saurabh Jain, Sunil Kumar Yadav, Ting Cai, Wei-Te Chen, Yandi Xia, Yuki Nakayama, Yutaka Higashiyama

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；foundation model(abstract)；分类 cs.CL、cs.LG

2310.14855 2024-03-20 cs.CL cs.AI 90%

Contextual Refinement of Translations: Large Language Models for Sentence and Document-Level Post-Editing

Sai Koneru, Miriam Exel, Matthias Huck, Jan Niehues

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments NAACL 2024

2403.11671 2024-03-19 cs.AR cs.AI cs.CE cs.LG cs.SE 90%

HDLdebugger: Streamlining HDL debugging with Large Language Models

Xufeng Yao, Haoyang Li, Tsz Ho Chan, Wenyi Xiao, Mingxuan Yuan, Yu Huang, Lei Chen, Bei Yu

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

Comments 13 pages,5 figures

2312.03724 2024-03-19 cs.CL cs.AI 90%

DP-OPT: Make Large Language Model Your Privacy-Preserving Prompt Engineer

Junyuan Hong, Jiachen T. Wang, Chenhui Zhang, Zhangheng Li, Bo Li, Zhangyang Wang

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments Accepted to ICLR'24 Splotlight (updated version)

2403.09720 2024-03-18 cs.CL cs.AI 90%

Fine-tuning vs Prompting, Can Language Models Understand Human Values?

Pingwei Sun

专题命中指令微调：language model(title,abstract)；prompting(title)；large language model(abstract)；RLHF(abstract)

2403.09072 2024-03-15 cs.CV cs.AI cs.CL 90%

UniCode: Learning a Unified Codebook for Multimodal Large Language Models

Sipeng Zheng, Bohan Zhou, Yicheng Feng, Ye Wang, Zongqing Lu

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；instruction tuning(abstract)；分类 cs.CL、cs.AI

Comments 14 pages, 2 figures, 11 tables

2403.03170 2024-03-12 cs.MM cs.AI cs.CL cs.CV cs.CY 90%

SNIFFER: Multimodal Large Language Model for Explainable Out-of-Context Misinformation Detection

Peng Qi, Zehong Yan, Wynne Hsu, Mong Li Lee

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；instruction tuning(abstract)；分类 cs.CL、cs.AI

Comments To appear in CVPR 2024

2403.04510 2024-03-08 cs.CL cs.AI 90%

Where does In-context Translation Happen in Large Language Models

Suzanna Sia, David Mueller, Kevin Duh

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；prompting(abstract)；分类 cs.CL、cs.AI

Comments 19 pages. Under Review

2311.11608 2024-03-06 cs.CL cs.AI 90%

Taiyi: A Bilingual Fine-Tuned Large Language Model for Diverse Biomedical Tasks

Ling Luo, Jinzhong Ning, Yingwen Zhao, Zhijun Wang, Zeyuan Ding, Peng Chen, Weiru Fu, Qinyu Han, Guangtao Xu, Yunzhi Qiu, Dinghao Pan, Jiru Li, Hao Li, Wenduo Feng, Senbo Tu, Yuqi Liu, Zhihao Yang, Jian Wang, Yuanyuan Sun, Hongfei Lin

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Journal ref Journal of the American Medical Informatics Association, 2024, ocae037

2309.13192 2024-03-01 cs.LG cs.AI 90%

Towards Green AI in Fine-tuning Large Language Models via Adaptive Backpropagation

Kai Huang, Hanyun Yin, Heng Huang, Wei Gao

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.AI、cs.LG

Comments 16 pages

2402.13866 2024-02-27 cs.CL cs.AI 90%

Kuaiji: the First Chinese Accounting Large Language Model

Jiayuan Luo, Songhua Yang, Xiaoling Qiu, Panyu Chen, Yufei Nai, Wenxuan Zeng, Wentao Zhang, Xinke Jiang

专题命中指令微调：large language model(title,abstract)；language model(title,abstract)；LLM(abstract)；分类 cs.CL、cs.AI

Comments version 2.0

1. 指令微调 11654 篇

ApiQ: Finetuning of 2-Bit Quantized Large Language Model

Optimizing Psychological Counseling with Instruction-Tuned Large Language Models

Text as Images: Can Multimodal Large Language Models Follow Printed Instructions in Pixels?

Seventeenth-Century Spanish American Notary Records for Fine-Tuning Spanish Large Language Models

Stealthy and Persistent Unalignment on Large Language Models via Backdoor Injections

STAR: Constraint LoRA with Dynamic Active Learning for Data-Efficient Fine-Tuning of Large Language Models

Assessing Political Bias in Large Language Models

tnGPS: Discovering Unknown Tensor Network Structure Search Algorithms via Large Language Models (LLMs)

How Multilingual Are Large Language Models Fine-Tuned for Translation?

Federated Fine-tuning of Large Language Models under Heterogeneous Tasks and Client Resources

Large Language Models as Zero-shot Dialogue State Tracker through Function Calling

Large Language Models in Wireless Application Design: In-Context Learning-enhanced Automatic Network Intrusion Detection

How Can Large Language Models Understand Spatial-Temporal Data?

Word2World: Generating Stories and Worlds through Large Language Models

Cultural Alignment in Large Language Models: An Explanatory Analysis Based on Hofstede's Cultural Dimensions

Meta In-Context Learning Makes Large Language Models Better Zero and Few-Shot Relation Extractors

GROUNDHOG: Grounding Large Language Models to Holistic Segmentation

Towards Safety and Helpfulness Balanced Responses via Controllable Large Language Models

mPLUG-Owl: Modularization Empowers Large Language Models with Multimodality

RakutenAI-7B: Extending Large Language Models for Japanese

Contextual Refinement of Translations: Large Language Models for Sentence and Document-Level Post-Editing

HDLdebugger: Streamlining HDL debugging with Large Language Models

DP-OPT: Make Large Language Model Your Privacy-Preserving Prompt Engineer

Fine-tuning vs Prompting, Can Language Models Understand Human Values?

UniCode: Learning a Unified Codebook for Multimodal Large Language Models

SNIFFER: Multimodal Large Language Model for Explainable Out-of-Context Misinformation Detection

Where does In-context Translation Happen in Large Language Models

Taiyi: A Bilingual Fine-Tuned Large Language Model for Diverse Biomedical Tasks

Towards Green AI in Fine-tuning Large Language Models via Adaptive Backpropagation

Kuaiji: the First Chinese Accounting Large Language Model