语言大模型 / LLM - arXivDaily 专题

2306.11400 2024-07-16 cs.CV cs.CL 79%

MuDPT: Multi-modal Deep-symphysis Prompt Tuning for Large Pre-trained Vision-Language Models

Yongzhu Miao, Shasha Li, Jintao Tang, Ting Wang

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments The paper has been accepted by ICME 2023

2401.13537 2024-07-12 hep-ph cs.LG hep-ex physics.data-an 79%

Masked Particle Modeling on Sets: Towards Self-Supervised High Energy Physics Foundation Models

Tobias Golling, Lukas Heinrich, Michael Kagan, Samuel Klein, Matthew Leigh, Margarita Osadchy, John Andrew Raine

专题命中指令微调：foundation model(title,abstract)；分类 cs.LG

2309.06824 2024-07-09 cs.CV cs.AI 79%

Beyond Adapting SAM: Towards End-to-End Ultrasound Image Segmentation via Auto Prompting

Xian Lin, Yangyang Xiang, Li Yu, Zengqiang Yan

专题命中指令微调：prompting(title)；foundation model(abstract)；分类 cs.AI

Comments Also known as SAMUS. Officially accepted by MICCAI 2024

2407.02723 2024-07-04 cs.CL 79%

e-Health CSIRO at "Discharge Me!" 2024: Generating Discharge Summary Sections with Fine-tuned Language Models

Jinghui Liu, Aaron Nicolson, Jason Dowling, Bevan Koopman, Anthony Nguyen

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments BioNLP @ ACL 2024

2308.13320 2024-07-02 cs.LG cs.CV 79%

Fine-tuning can cripple your foundation model; preserving features may be the solution

Jishnu Mukhoti, Yarin Gal, Philip H. S. Torr, Puneet K. Dokania

专题命中指令微调：foundation model(title,abstract)；分类 cs.LG

Comments Published in TMLR: https://openreview.net/forum?id=kfhoeZCeW7

2406.19888 2024-07-01 cs.AI 79%

Fine-tuning of Geospatial Foundation Models for Aboveground Biomass Estimation

Michal Muszynski, Levente Klein, Ademir Ferreira da Silva, Anjani Prasad Atluri, Carlos Gomes, Daniela Szwarcman, Gurkanwar Singh, Kewen Gu, Maciel Zortea, Naomi Simumba, Paolo Fraccaro, Shraddha Singh, Steve Meliksetian, Campbell Watson, Daiki Kimura, Harini Srinivasan

专题命中指令微调：foundation model(title,abstract)；分类 cs.AI

2401.08574 2024-06-28 cs.CL 79%

Deductive Closure Training of Language Models for Coherence, Accuracy, and Updatability

Afra Feyza Akyürek, Ekin Akyürek, Leshem Choshen, Derry Wijaya, Jacob Andreas

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments ACL Findings

2404.03820 2024-06-24 cs.CL 79%

CantTalkAboutThis: Aligning Language Models to Stay on Topic in Dialogues

Makesh Narsimhan Sreedhar, Traian Rebedea, Shaona Ghosh, Jiaqi Zeng, Christopher Parisien

专题命中指令微调：language model(title,abstract)；分类 cs.CL

2406.11815 2024-06-18 cs.RO cs.CV cs.LG 79%

LLARVA: Vision-Action Instruction Tuning Enhances Robot Learning

Dantong Niu, Yuvan Sharma, Giscard Biamby, Jerome Quenum, Yutong Bai, Baifeng Shi, Trevor Darrell, Roei Herzig

专题命中指令微调：instruction tuning(title,abstract)；分类 cs.LG

2308.09568 2024-06-18 cs.CV cs.CL 79%

PUMGPT: A Large Vision-Language Model for Product Understanding

Wei Xue, Zongyi Guo, Baoliang Cui, Zheng Xing, Xiaoyi Zeng, Xiufei Wang, Shuhui Wu, Weiming Lu

专题命中指令微调：language model(title,abstract)；分类 cs.CL

2406.10507 2024-06-18 eess.AS cs.CL cs.SD 79%

Benchmarking Children's ASR with Supervised and Self-supervised Speech Foundation Models

Ruchao Fan, Natarajan Balaji Shankar, Abeer Alwan

专题命中指令微调：foundation model(title,abstract)；分类 cs.CL

Comments To appear in Interspeech 2024

2405.09805 2024-06-14 cs.CL cs.CR 79%

SecureLLM: Using Compositionality to Build Provably Secure Language Models for Private, Sensitive, and Secret Data

Abdulrahman Alabdulkareem, Christian M Arnold, Yerim Lee, Pieter M Feenstra, Boris Katz, Andrei Barbu

专题命中指令微调：language model(title)；LLM(abstract)；分类 cs.CL

2406.08796 2024-06-14 cs.CL 79%

Deep Exploration of Cross-Lingual Zero-Shot Generalization in Instruction Tuning

Janghoon Han, Changho Lee, Joongbo Shin, Stanley Jungkyu Choi, Honglak Lee, Kynghoon Bae

专题命中指令微调：instruction tuning(title,abstract)；分类 cs.CL

Comments Findings of ACL 2024 (Camera-ready), by Janghoon Han and Changho Lee, with equal contribution

2406.07288 2024-06-12 cs.CL 79%

Fine-tuning with HED-IT: The impact of human post-editing for dialogical language models

Daniela Occhipinti, Michele Marchi, Irene Mondella, Huiyuan Lai, Felice Dell'Orletta, Malvina Nissim, Marco Guerini

专题命中指令微调：language model(title,abstract)；分类 cs.CL

2402.15637 2024-06-07 cs.CL 79%

Addressing Order Sensitivity of In-Context Demonstration Examples in Causal Language Models

Yanzheng Xiang, Hanqi Yan, Lin Gui, Yulan He

专题命中指令微调：language model(title,abstract)；分类 cs.CL

2406.00164 2024-06-04 q-bio.GN cs.AI 79%

DYNA: Disease-Specific Language Model for Variant Pathogenicity

Huixin Zhan, Zijun Zhang

专题命中指令微调：language model(title)；foundation model(abstract)；分类 cs.AI

2309.10019 2024-06-04 cs.CV cs.LG 79%

Long-Tail Learning with Foundation Model: Heavy Fine-Tuning Hurts

Jiang-Xin Shi, Tong Wei, Zhi Zhou, Jie-Jing Shao, Xin-Yan Han, Yu-Feng Li

专题命中指令微调：foundation model(title,abstract)；分类 cs.LG

Comments Accepted by ICML 2024

2405.11756 2024-05-21 cs.LG 79%

Erasing the Bias: Fine-Tuning Foundation Models for Semi-Supervised Learning

Kai Gan, Tong Wei

专题命中指令微调：foundation model(title,abstract)；分类 cs.LG

Comments Accepted to ICML 2024

2405.08497 2024-05-15 cs.CL 79%

Is Less More? Quality, Quantity and Context in Idiom Processing with Natural Language Models

Agne Knietaite, Adam Allsebrook, Anton Minkov, Adam Tomaszewski, Norbert Slinko, Richard Johnson, Thomas Pickard, Dylan Phelps, Aline Villavicencio

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments 14 pages, 10 figures. Presented at the Joint Workshop on Multiword Expressions and Universal Dependencies (MWE-UD 2024) https://multiword.org/mweud2024/

2405.06729 2024-05-14 q-bio.GN cs.LG 79%

Fine-tuning Protein Language Models with Deep Mutational Scanning improves Variant Effect Prediction

Aleix Lafita, Ferran Gonzalez, Mahmoud Hossam, Paul Smyth, Jacob Deasy, Ari Allyn-Feuer, Daniel Seaton, Stephen Young

专题命中指令微调：language model(title,abstract)；分类 cs.LG

Comments Machine Learning for Genomics Explorations workshop at ICLR 2024

2305.12829 2024-04-29 cs.CL 79%

On Bias and Fairness in NLP: Investigating the Impact of Bias and Debiasing in Language Models on the Fairness of Toxicity Detection

Fatma Elsafoury, Stamos Katsigiannis

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments 10 pages

2404.16339 2024-04-26 cs.CV cs.AI 79%

Training-Free Unsupervised Prompt for Vision-Language Models

Sifan Long, Linbin Wang, Zhen Zhao, Zichang Tan, Yiming Wu, Shengsheng Wang, Jingdong Wang

专题命中指令微调：language model(title,abstract)；分类 cs.AI

2305.14244 2024-04-23 cs.LG 79%

Federated Prompt Learning for Weather Foundation Models on Devices

Shengchao Chen, Guodong Long, Tao Shen, Jing Jiang, Chengqi Zhang

专题命中指令微调：foundation model(title,abstract)；分类 cs.LG

Comments Accepted by Main Track in IJCAI'24 (the 33rd International Joint Conference on Artificial Intelligence)

2404.12717 2024-04-22 cs.RO cs.AI 79%

Show and Grasp: Few-shot Semantic Segmentation for Robot Grasping through Zero-shot Foundation Models

Leonardo Barcellona, Alberto Bacchin, Matteo Terreran, Emanuele Menegatti, Stefano Ghidoni

专题命中指令微调：foundation model(title,abstract)；分类 cs.AI

2404.10174 2024-04-17 cs.CL 79%

On the Effects of Fine-tuning Language Models for Text-Based Reinforcement Learning

Mauricio Gruppi, Soham Dan, Keerthiram Murugesan, Subhajit Chaudhury

专题命中指令微调：language model(title,abstract)；分类 cs.CL

2310.19956 2024-04-12 cs.CL 79%

The Impact of Depth on Compositional Generalization in Transformer Language Models

Jackson Petty, Sjoerd van Steenkiste, Ishita Dasgupta, Fei Sha, Dan Garrette, Tal Linzen

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments Accepted to NAACL 2024

2404.06261 2024-04-10 cs.CV cs.AI cs.RO 79%

Playing to Vision Foundation Model's Strengths in Stereo Matching

Chuang-Wei Liu, Qijun Chen, Rui Fan

专题命中指令微调：foundation model(title,abstract)；分类 cs.AI

2311.09502 2024-04-10 cs.CL 79%

SQATIN: Supervised Instruction Tuning Meets Question Answering for Improved Dialogue NLU

Evgeniia Razumovskaia, Goran Glavaš, Anna Korhonen, Ivan Vulić

专题命中指令微调：instruction tuning(title,abstract)；分类 cs.CL

Comments Accepted to NAACL Main 2024

2404.05560 2024-04-09 cs.CL 79%

Chinese Sequence Labeling with Semi-Supervised Boundary-Aware Language Model Pre-training

Longhui Zhang, Dingkun Long, Meishan Zhang, Yanzhao Zhang, Pengjun Xie, Min Zhang

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments Accepted to COLING 2024

2403.18783 2024-03-28 cs.CL 79%

Towards a World-English Language Model for On-Device Virtual Assistants

Rricha Jalota, Lyan Verwimp, Markus Nussbaum-Thom, Amr Mousa, Arturo Argueta, Youssef Oualil

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments Accepted in ICASSP 2024

1. 指令微调 11667 篇

MuDPT: Multi-modal Deep-symphysis Prompt Tuning for Large Pre-trained Vision-Language Models

Masked Particle Modeling on Sets: Towards Self-Supervised High Energy Physics Foundation Models

Beyond Adapting SAM: Towards End-to-End Ultrasound Image Segmentation via Auto Prompting

e-Health CSIRO at "Discharge Me!" 2024: Generating Discharge Summary Sections with Fine-tuned Language Models

Fine-tuning can cripple your foundation model; preserving features may be the solution

Fine-tuning of Geospatial Foundation Models for Aboveground Biomass Estimation

Deductive Closure Training of Language Models for Coherence, Accuracy, and Updatability

CantTalkAboutThis: Aligning Language Models to Stay on Topic in Dialogues

LLARVA: Vision-Action Instruction Tuning Enhances Robot Learning

PUMGPT: A Large Vision-Language Model for Product Understanding

Benchmarking Children's ASR with Supervised and Self-supervised Speech Foundation Models

SecureLLM: Using Compositionality to Build Provably Secure Language Models for Private, Sensitive, and Secret Data

Deep Exploration of Cross-Lingual Zero-Shot Generalization in Instruction Tuning

Fine-tuning with HED-IT: The impact of human post-editing for dialogical language models

Addressing Order Sensitivity of In-Context Demonstration Examples in Causal Language Models

DYNA: Disease-Specific Language Model for Variant Pathogenicity

Long-Tail Learning with Foundation Model: Heavy Fine-Tuning Hurts

Erasing the Bias: Fine-Tuning Foundation Models for Semi-Supervised Learning

Is Less More? Quality, Quantity and Context in Idiom Processing with Natural Language Models

Fine-tuning Protein Language Models with Deep Mutational Scanning improves Variant Effect Prediction

On Bias and Fairness in NLP: Investigating the Impact of Bias and Debiasing in Language Models on the Fairness of Toxicity Detection

Training-Free Unsupervised Prompt for Vision-Language Models

Federated Prompt Learning for Weather Foundation Models on Devices

Show and Grasp: Few-shot Semantic Segmentation for Robot Grasping through Zero-shot Foundation Models

On the Effects of Fine-tuning Language Models for Text-Based Reinforcement Learning

The Impact of Depth on Compositional Generalization in Transformer Language Models

Playing to Vision Foundation Model's Strengths in Stereo Matching

SQATIN: Supervised Instruction Tuning Meets Question Answering for Improved Dialogue NLU

Chinese Sequence Labeling with Semi-Supervised Boundary-Aware Language Model Pre-training

Towards a World-English Language Model for On-Device Virtual Assistants