语言大模型 / LLM - arXivDaily 专题

2403.08776 2024-03-15 cs.CV cs.AI 79%

Leveraging Chat-Based Large Vision Language Models for Multimodal Out-Of-Context Detection

Fatma Shalabi, Hichem Felouat, Huy H. Nguyen, Isao Echizen

专题命中指令微调：language model(title,abstract)；分类 cs.AI

Comments 13 pages, 6 figures , conference

2402.16919 2024-02-28 cs.LG 79%

Personalized Federated Instruction Tuning via Neural Architecture Search

Pengyu Zhang, Yingbo Zhou, Ming Hu, Junxian Feng, Jiawen Weng, Mingsong Chen

专题命中指令微调：instruction tuning(title,abstract)；分类 cs.LG

2402.16842 2024-02-28 cs.LG 79%

Asymmetry in Low-Rank Adapters of Foundation Models

Jiacheng Zhu, Kristjan Greenewald, Kimia Nadjahi, Haitz Sáez de Ocáriz Borde, Rickard Brüel Gabrielsson, Leshem Choshen, Marzyeh Ghassemi, Mikhail Yurochkin, Justin Solomon

专题命中指令微调：foundation model(title,abstract)；分类 cs.LG

Comments 17 pages, 2 figures, 9 tables

2402.14052 2024-02-23 cs.CL 79%

On Leveraging Encoder-only Pre-trained Language Models for Effective Keyphrase Generation

Di Wu, Wasi Uddin Ahmad, Kai-Wei Chang

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments LREC-COLING 2024 camera ready. arXiv admin note: text overlap with arXiv:2212.10233

2401.06432 2024-02-22 cs.LG cs.DC 79%

Heterogeneous LoRA for Federated Fine-tuning of On-Device Foundation Models

Yae Jee Cho, Luyang Liu, Zheng Xu, Aldi Fahrezi, Gauri Joshi

专题命中指令微调：foundation model(title,abstract)；分类 cs.LG

2402.07519 2024-02-13 cs.CL cs.CY 79%

MAFIA: Multi-Adapter Fused Inclusive LanguAge Models

Prachi Jain, Ashutosh Sathe, Varun Gumma, Kabir Ahuja, Sunayana Sitaram

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments Accepted to EACL 2024

2402.06220 2024-02-12 cs.CL 79%

A Unified Causal View of Instruction Tuning

Lu Chen, Wei Huang, Ruqing Zhang, Wei Chen, Jiafeng Guo, Xueqi Cheng

专题命中指令微调：instruction tuning(title,abstract)；分类 cs.CL

2309.07929 2024-02-05 cs.CV cs.LG cs.MM cs.SD eess.AS 79%

Prompting Segmentation with Sound Is Generalizable Audio-Visual Source Localizer

Yaoting Wang, Weisong Liu, Guangyao Li, Jian Ding, Di Hu, Xi Li

专题命中指令微调：prompting(title)；foundation model(abstract)；分类 cs.LG

Comments Accepted by AAAI 2024

2401.09774 2024-01-19 cs.MM cs.CL cs.CV cs.SD eess.AS 79%

On the Audio Hallucinations in Large Audio-Video Language Models

Taichi Nishimura, Shota Nakada, Masayoshi Kondo

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments 6 pages

2310.12798 2024-01-19 cs.CL cs.MM 79%

MolCA: Molecular Graph-Language Modeling with Cross-Modal Projector and Uni-Modal Adapter

Zhiyuan Liu, Sihang Li, Yanchen Luo, Hao Fei, Yixin Cao, Kenji Kawaguchi, Xiang Wang, Tat-Seng Chua

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments EMNLP main conference. 9 pages

2312.09211 2024-01-17 cs.CL 79%

Mitigating Outlier Activations in Low-Precision Fine-Tuning of Language Models

Alireza Ghaffari, Justin Yu, Mahsa Ghazvini Nejad, Masoud Asgharian, Boxing Chen, Vahid Partovi Nia

专题命中指令微调：language model(title,abstract)；分类 cs.CL

2401.06013 2024-01-15 cs.CV cs.AI 79%

Surgical-DINO: Adapter Learning of Foundation Models for Depth Estimation in Endoscopic Surgery

Beilei Cui, Mobarakol Islam, Long Bai, Hongliang Ren

专题命中指令微调：foundation model(title,abstract)；分类 cs.AI

Comments Accepted by IPCAI 2024 (IJCAR Special Issue)

2401.04025 2024-01-09 cs.CL 79%

IDoFew: Intermediate Training Using Dual-Clustering in Language Models for Few Labels Text Classification

Abdullah Alsuhaibani, Hamad Zogan, Imran Razzak, Shoaib Jameel, Guandong Xu

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments Published in The 17th ACM International Conference on Web Search and Data Mining

2309.08023 2024-01-09 eess.AS cs.LG cs.SD 79%

USM-SCD: Multilingual Speaker Change Detection Based on Large Pretrained Foundation Models

Guanlong Zhao, Yongqiang Wang, Jason Pelecanos, Yu Zhang, Hank Liao, Yiling Huang, Han Lu, Quan Wang

专题命中指令微调：foundation model(title,abstract)；分类 cs.LG

Comments 5 pages, 2 figures, 4 tables

2305.04106 2024-01-05 cs.SE cs.LG 79%

On the Usage of Continual Learning for Out-of-Distribution Generalization in Pre-trained Language Models of Code

Martin Weyssow, Xin Zhou, Kisub Kim, David Lo, Houari Sahraoui

专题命中指令微调：language model(title,abstract)；分类 cs.LG

Journal ref ESEC/FSE 2023

2312.17349 2024-01-01 cs.CL 79%

Language Model as an Annotator: Unsupervised Context-aware Quality Phrase Generation

Zhihao Zhang, Yuan Zuo, Chenghua Lin, Junjie Wu

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Journal ref Knowledge-Based Systems 2024

2312.09000 2023-12-15 cs.CL 79%

ComOM at VLSP 2023: A Dual-Stage Framework with BERTology and Unified Multi-Task Instruction Tuning Model for Vietnamese Comparative Opinion Mining

Dang Van Thin, Duong Ngoc Hao, Ngan Luu-Thuy Nguyen

专题命中指令微调：instruction tuning(title,abstract)；分类 cs.CL

Comments Accepted manuscript at VLSP 2023

2311.14904 2023-11-28 cs.LG cs.SE 79%

LLM-Assisted Code Cleaning For Training Accurate Code Generators

Naman Jain, Tianjun Zhang, Wei-Lin Chiang, Joseph E. Gonzalez, Koushik Sen, Ion Stoica

专题命中指令微调：LLM(title,abstract)；分类 cs.LG

2310.19106 2023-11-28 cs.CL 79%

PACuna: Automated Fine-Tuning of Language Models for Particle Accelerators

Antonin Sulc, Raimund Kammering, Annika Eichler, Tim Wilksen

专题命中指令微调：language model(title,abstract)；分类 cs.CL

2311.12582 2023-11-22 eess.IV cs.AI cs.CV 79%

Echocardiogram Foundation Model -- Application 1: Estimating Ejection Fraction

Adil Dahlan, Cyril Zakka, Abhinav Kumar, Laura Tang, Rohan Shad, Robyn Fong, William Hiesinger

专题命中指令微调：foundation model(title,abstract)；分类 cs.AI

2311.12404 2023-11-22 cs.CL cs.IR 79%

InterPrompt: Interpretable Prompting for Interrelated Interpersonal Risk Factors in Reddit Posts

MSVPJ Sathvik, Surjodeep Sarkar, Chandni Saxena, Sunghwan Sohn, Muskan Garg

专题命中指令微调：prompting(title,abstract)；分类 cs.CL

Comments 5 pages

2311.11226 2023-11-21 cs.AI cs.IR 79%

An Interactive Query Generation Assistant using LLM-based Prompt Modification and User Feedback

Kaustubh D. Dhole, Ramraj Chandradevan, Eugene Agichtein

专题命中指令微调：LLM(title)；prompting(abstract)；分类 cs.AI

Comments Intelligence Advanced Research Projects Activity (IARPA) BETTER Research Program

2310.02971 2023-11-16 eess.AS cs.CL eess.SP 79%

Prompting and Adapter Tuning for Self-supervised Encoder-Decoder Speech Model

Kai-Wei Chang, Ming-Hsin Chen, Yun-Ping Lin, Jing Neng Hsu, Paul Kuo-Ming Huang, Chien-yu Huang, Shang-Wen Li, Hung-yi Lee

专题命中指令微调：prompting(title,abstract)；分类 cs.CL

Comments Accepted to IEEE ASRU 2023

2311.06493 2023-11-14 cs.CL 79%

L3 Ensembles: Lifelong Learning Approach for Ensemble of Foundational Language Models

Aidin Shiri, Kaushik Roy, Amit Sheth, Manas Gaur

专题命中指令微调：language model(title,abstract)；分类 cs.CL

2206.05658 2023-11-13 cs.CL 79%

Improving Pre-trained Language Model Fine-tuning with Noise Stability Regularization

Hang Hua, Xingjian Li, Dejing Dou, Cheng-Zhong Xu, Jiebo Luo

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments Accepted by TNNLS

2310.20348 2023-11-01 cs.CV cs.LG 79%

Class Incremental Learning with Pre-trained Vision-Language Models

Xialei Liu, Xusheng Cao, Haori Lu, Jia-wen Xiao, Andrew D. Bagdanov, Ming-Ming Cheng

专题命中指令微调：language model(title,abstract)；分类 cs.LG

2306.04751 2023-11-01 cs.CL 79%

How Far Can Camels Go? Exploring the State of Instruction Tuning on Open Resources

Yizhong Wang, Hamish Ivison, Pradeep Dasigi, Jack Hessel, Tushar Khot, Khyathi Raghavi Chandu, David Wadden, Kelsey MacMillan, Noah A. Smith, Iz Beltagy, Hannaneh Hajishirzi

专题命中指令微调：instruction tuning(title)；language model(abstract)；分类 cs.CL

Comments 18 pages, 6 figure, 10 tables. NeurIPS 2023 Datasets and Benchmarks Track Camera Ready

2310.16240 2023-10-26 cs.CL 79%

Mixture-of-Linguistic-Experts Adapters for Improving and Interpreting Pre-trained Language Models

Raymond Li, Gabriel Murray, Giuseppe Carenini

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments 14 pages, 3 figures, Camera-Ready for EMNLP 2023 Findings (Long Paper)

2310.14510 2023-10-24 cs.CL 79%

CITB: A Benchmark for Continual Instruction Tuning

Zihan Zhang, Meng Fang, Ling Chen, Mohammad-Reza Namazi-Rad

专题命中指令微调：instruction tuning(title,abstract)；分类 cs.CL

Comments EMNLP 2023 Findings

2310.12490 2023-10-20 cs.CL 79%

Co$^2$PT: Mitigating Bias in Pre-trained Language Models through Counterfactual Contrastive Prompt Tuning

Xiangjue Dong, Ziwei Zhu, Zhuoer Wang, Maria Teleki, James Caverlee

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments To appear in Findings of EMNLP 2023

1. 指令微调 11667 篇

Leveraging Chat-Based Large Vision Language Models for Multimodal Out-Of-Context Detection

Personalized Federated Instruction Tuning via Neural Architecture Search

Asymmetry in Low-Rank Adapters of Foundation Models

On Leveraging Encoder-only Pre-trained Language Models for Effective Keyphrase Generation

Heterogeneous LoRA for Federated Fine-tuning of On-Device Foundation Models

MAFIA: Multi-Adapter Fused Inclusive LanguAge Models

A Unified Causal View of Instruction Tuning

Prompting Segmentation with Sound Is Generalizable Audio-Visual Source Localizer

On the Audio Hallucinations in Large Audio-Video Language Models

MolCA: Molecular Graph-Language Modeling with Cross-Modal Projector and Uni-Modal Adapter

Mitigating Outlier Activations in Low-Precision Fine-Tuning of Language Models

Surgical-DINO: Adapter Learning of Foundation Models for Depth Estimation in Endoscopic Surgery

IDoFew: Intermediate Training Using Dual-Clustering in Language Models for Few Labels Text Classification

USM-SCD: Multilingual Speaker Change Detection Based on Large Pretrained Foundation Models

On the Usage of Continual Learning for Out-of-Distribution Generalization in Pre-trained Language Models of Code

Language Model as an Annotator: Unsupervised Context-aware Quality Phrase Generation

ComOM at VLSP 2023: A Dual-Stage Framework with BERTology and Unified Multi-Task Instruction Tuning Model for Vietnamese Comparative Opinion Mining

LLM-Assisted Code Cleaning For Training Accurate Code Generators

PACuna: Automated Fine-Tuning of Language Models for Particle Accelerators

Echocardiogram Foundation Model -- Application 1: Estimating Ejection Fraction

InterPrompt: Interpretable Prompting for Interrelated Interpersonal Risk Factors in Reddit Posts

An Interactive Query Generation Assistant using LLM-based Prompt Modification and User Feedback

Prompting and Adapter Tuning for Self-supervised Encoder-Decoder Speech Model

L3 Ensembles: Lifelong Learning Approach for Ensemble of Foundational Language Models

Improving Pre-trained Language Model Fine-tuning with Noise Stability Regularization

Class Incremental Learning with Pre-trained Vision-Language Models

How Far Can Camels Go? Exploring the State of Instruction Tuning on Open Resources

Mixture-of-Linguistic-Experts Adapters for Improving and Interpreting Pre-trained Language Models

CITB: A Benchmark for Continual Instruction Tuning

Co$^2$PT: Mitigating Bias in Pre-trained Language Models through Counterfactual Contrastive Prompt Tuning