语言大模型 / LLM - arXivDaily 专题

2411.10534 2024-11-19 cs.HC cs.AI cs.CY 79%

Chain of Alignment: Integrating Public Will with Expert Intelligence for Language Model Alignment

Andrew Konya, Aviv Ovadya, Kevin Feng, Quan Ze Chen, Lisa Schirch, Colin Irwin, Amy X. Zhang

专题命中指令微调：language model(title,abstract)；分类 cs.AI

Comments Pluralistic Alignment Workshop at NeurIPS 2024

2411.08652 2024-11-14 cs.LG 79%

Accelerating Quasi-Static Time Series Simulations with Foundation Models

Alban Puech, François Mirallès, Jonas Weiss, Vincent Mai, Alexandre Blondin Massé, Martin de Montigny, Thomas Brunschwiler, Hendrik F. Hamann

专题命中指令微调：foundation model(title,abstract)；分类 cs.LG

Comments Equal contributors: A.P. and F.M.; Lead contact: A.P

2411.05898 2024-11-12 cs.CV cs.AI cs.RO 79%

Integrating Object Detection Modality into Visual Language Model for Enhanced Autonomous Driving Agent

Linfeng He, Yiming Sun, Sihao Wu, Jiaxu Liu, Xiaowei Huang

专题命中指令微调：language model(title,abstract)；分类 cs.AI

Comments accepted by SafeGenAI workshop of NeurIPS 2024

2311.01723 2024-11-08 cs.CV cs.AI 79%

Towards Calibrated Robust Fine-Tuning of Vision-Language Models

Changdae Oh, Hyesu Lim, Mijoo Kim, Dongyoon Han, Sangdoo Yun, Jaegul Choo, Alexander Hauptmann, Zhi-Qi Cheng, Kyungwoo Song

专题命中指令微调：language model(title,abstract)；分类 cs.AI

Comments NeurIPS 2024 (a short version was presented at the NeurIPS 2023 Workshop on Distribution Shifts); Major modification of (v7): Fixing the x-axis of Figure 3 and Pearson correlation, accordingly

2411.03707 2024-11-07 cs.CV cs.AI 79%

Fine-Tuning Vision-Language Model for Automated Engineering Drawing Information Extraction

Muhammad Tayyab Khan, Lequn Chen, Ye Han Ng, Wenhe Feng, Nicholas Yew Jin Tan, Seung Ki Moon

专题命中指令微调：language model(title,abstract)；分类 cs.AI

Comments Paper has been submitted to the 9th International Conference on Innovation in Artificial Intelligence (ICIAI 2025)

2411.01855 2024-11-05 cs.CL 79%

Can Language Models Learn to Skip Steps?

Tengxiao Liu, Qipeng Guo, Xiangkun Hu, Cheng Jiayang, Yue Zhang, Xipeng Qiu, Zheng Zhang

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments Accepted by NeurIPS 2024

2405.18330 2024-11-05 cs.CV cs.AI 79%

Frustratingly Easy Test-Time Adaptation of Vision-Language Models

Matteo Farina, Gianni Franchi, Giovanni Iacca, Massimiliano Mancini, Elisa Ricci

专题命中指令微调：language model(title,abstract)；分类 cs.AI

Comments Camera-ready version for NeurIPS 2024

2410.00025 2024-10-31 cs.CL cs.SD eess.AS 79%

Improving Spoken Language Modeling with Phoneme Classification: A Simple Fine-tuning Approach

Maxime Poli, Emmanuel Chemla, Emmanuel Dupoux

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments Accepted at EMNLP 2024 main conference. 9 pages, 4 figures

2306.06755 2024-10-31 cs.PL cs.AI cs.SE 79%

CoTran: An LLM-based Code Translator using Reinforcement Learning with Feedback from Compiler and Symbolic Execution

Prithwish Jana, Piyush Jha, Haoyang Ju, Gautham Kishore, Aryan Mahajan, Vijay Ganesh

专题命中指令微调：LLM(title,abstract)；分类 cs.AI

Comments The paper has been published at the 27th European Conference on Artificial Intelligence (ECAI-2024) and is available at https://ebooks.iospress.nl/doi/10.3233/FAIA240968. This arXiv version is the full version that includes the supplementary material (Appendix)

2410.21749 2024-10-30 cs.LG 79%

Reliable and Compact Graph Fine-tuning via GraphSparse Prompting

Bo Jiang, Hao Wu, Beibei Wang, Jin Tang, Bin Luo

专题命中指令微调：prompting(title,abstract)；分类 cs.LG

2410.16029 2024-10-22 cs.LG cs.MA 79%

Natural GaLore: Accelerating GaLore for memory-efficient LLM Training and Fine-tuning

Arijit Das

专题命中指令微调：LLM(title)；pretraining(abstract)；分类 cs.LG

Comments 10 pages, 3 tables, 3 figures

2410.15821 2024-10-22 cs.AI 79%

The effect of fine-tuning on language model toxicity

Will Hawkins, Brent Mittelstadt, Chris Russell

专题命中指令微调：language model(title,abstract)；分类 cs.AI

Comments To be presented at NeurIPS 2024 Safe Generative AI Workshop

2410.14890 2024-10-22 cs.AI 79%

Reasoning, Memorization, and Fine-Tuning Language Models for Non-Cooperative Games

Yunhao Yang, Leonard Berthellemy, Ufuk Topcu

专题命中指令微调：language model(title,abstract)；分类 cs.AI

2410.13332 2024-10-18 cs.CL 79%

Fine-Tuning Language Models on Multiple Datasets for Citation Intention Classification

Zeren Shui, Petros Karypis, Daniel S. Karls, Mingjian Wen, Saurav Manchanda, Ellad B. Tadmor, George Karypis

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments To be appear as a Findings paper at EMNLP 2024

2404.16418 2024-10-18 cs.CL 79%

Instruction Matters: A Simple yet Effective Task Selection for Optimized Instruction Tuning of Specific Tasks

Changho Lee, Janghoon Han, Seonghyeon Ye, Stanley Jungkyu Choi, Honglak Lee, Kyunghoon Bae

专题命中指令微调：instruction tuning(title,abstract)；分类 cs.CL

Comments EMNLP 2024 (Camera-ready), by Janghoon Han and Changho Lee, with equal contribution

2410.12948 2024-10-18 cs.CL cs.SD eess.AS 79%

What Do Speech Foundation Models Not Learn About Speech?

Abdul Waheed, Hanin Atwany, Bhiksha Raj, Rita Singh

专题命中指令微调：foundation model(title,abstract)；分类 cs.CL

Comments 20 Pages

2410.12790 2024-10-17 cs.CV cs.LG 79%

Dual Prototype Evolving for Test-Time Generalization of Vision-Language Models

Ce Zhang, Simon Stepputtis, Katia Sycara, Yaqi Xie

专题命中指令微调：language model(title,abstract)；分类 cs.LG

Comments Accepted by NeurIPS 2024. Project page: https://zhangce01.github.io/DPE-CLIP

2408.01308 2024-10-17 cs.CL 79%

Reconsidering Degeneration of Token Embeddings with Definitions for Encoder-based Pre-trained Language Models

Ying Zhang, Dongyuan Li, Manabu Okumura

专题命中指令微调：language model(title,abstract)；分类 cs.CL

2406.10777 2024-10-17 cs.CL 79%

RoseLoRA: Row and Column-wise Sparse Low-rank Adaptation of Pre-trained Language Model for Knowledge Editing and Fine-tuning

Haoyu Wang, Tianci Liu, Ruirui Li, Monica Cheng, Tuo Zhao, Jing Gao

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments EMNLP 2024 main

2410.06520 2024-10-10 cs.CL 79%

A Novel LLM-based Two-stage Summarization Approach for Long Dialogues

Yuan-Jhe Yin, Bo-Yu Chen, Berlin Chen

专题命中指令微调：LLM(title)；language model(abstract)；分类 cs.CL

2410.02069 2024-10-07 cs.CV cs.LG 79%

Semi-Supervised Fine-Tuning of Vision Foundation Models with Content-Style Decomposition

Mariia Drozdova, Vitaliy Kinakh, Yury Belousov, Erica Lastufka, Slava Voloshynovskiy

专题命中指令微调：foundation model(title,abstract)；分类 cs.LG

Comments preprint

2409.19696 2024-10-01 cs.LG cs.CV 79%

Vision-Language Models are Strong Noisy Label Detectors

Tong Wei, Hao-Tian Li, Chun-Shu Li, Jiang-Xin Shi, Yu-Feng Li, Min-Ling Zhang

专题命中指令微调：language model(title,abstract)；分类 cs.LG

Comments Accepted at NeurIPS 2024

2409.19407 2024-10-01 q-bio.NC cs.AI cs.CV 79%

Brain-JEPA: Brain Dynamics Foundation Model with Gradient Positioning and Spatiotemporal Masking

Zijian Dong, Ruilin Li, Yilei Wu, Thuan Tinh Nguyen, Joanna Su Xian Chong, Fang Ji, Nathanael Ren Jie Tong, Christopher Li Hsian Chen, Juan Helen Zhou

专题命中指令微调：foundation model(title,abstract)；分类 cs.AI

Comments The first two authors contributed equally. NeurIPS 2024 Spotlight

2406.07424 2024-09-25 cs.CL 79%

MINERS: Multilingual Language Models as Semantic Retrievers

Genta Indra Winata, Ruochen Zhang, David Ifeoluwa Adelani

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments Accepted by EMNLP 2024 Findings

2409.13598 2024-09-23 cs.LG physics.ao-ph 79%

Prithvi WxC: Foundation Model for Weather and Climate

Johannes Schmude, Sujit Roy, Will Trojak, Johannes Jakubik, Daniel Salles Civitarese, Shraddha Singh, Julian Kuehnert, Kumar Ankur, Aman Gupta, Christopher E Phillips, Romeo Kienzler, Daniela Szwarcman, Vishal Gaur, Rajat Shinde, Rohit Lal, Arlindo Da Silva, Jorge Luis Guevara Diaz, Anne Jones, Simon Pfreundschuh, Amy Lin, Aditi Sheshadri, Udaysankar Nair, Valentine Anantharaj, Hendrik Hamann, Campbell Watson, Manil Maskey, Tsengdar J Lee, Juan Bernabe Moreno, Rahul Ramachandran

专题命中指令微调：foundation model(title,abstract)；分类 cs.LG

2205.07208 2024-09-17 cs.CL 79%

Fine-tuning Pre-trained Language Models for Few-shot Intent Detection: Supervised Pre-training and Isotropization

Haode Zhang, Haowen Liang, Yuwei Zhang, Liming Zhan, Xiaolei Lu, Albert Y. S. Lam, Xiao-Ming Wu

专题命中指令微调：language model(title,abstract)；分类 cs.CL

Comments NAACL 2022, oral

2409.05997 2024-09-11 cs.CL 79%

TransformerRanker: A Tool for Efficiently Finding the Best-Suited Language Models for Downstream Classification Tasks

Lukas Garbas, Max Ploner, Alan Akbik

专题命中指令微调：language model(title,abstract)；分类 cs.CL

2311.11261 2024-08-20 cs.CV cs.AI 79%

Adversarial Prompt Tuning for Vision-Language Models

Jiaming Zhang, Xingjun Ma, Xin Wang, Lingyu Qiu, Jiaqi Wang, Yu-Gang Jiang, Jitao Sang

专题命中指令微调：language model(title,abstract)；分类 cs.AI

Comments ECCV 2024

2309.14928 2024-07-31 cs.CV cs.LG 79%

Noise-Tolerant Few-Shot Unsupervised Adapter for Vision-Language Models

Eman Ali, Muhammad Haris Khan

专题命中指令微调：language model(title,abstract)；分类 cs.LG

Comments Accepted at BMVC 2024

2306.06048 2024-07-30 cs.CV cs.CY cs.LG 79%

How Does Fine-Tuning Impact Out-of-Distribution Detection for Vision-Language Models?

Yifei Ming, Yixuan Li

专题命中指令微调：language model(title,abstract)；分类 cs.LG

Comments Accepted to IJCV 2023

Journal ref International Journal of Computer Vision 2023

1. 指令微调 11667 篇

Chain of Alignment: Integrating Public Will with Expert Intelligence for Language Model Alignment

Accelerating Quasi-Static Time Series Simulations with Foundation Models

Integrating Object Detection Modality into Visual Language Model for Enhanced Autonomous Driving Agent

Towards Calibrated Robust Fine-Tuning of Vision-Language Models

Fine-Tuning Vision-Language Model for Automated Engineering Drawing Information Extraction

Can Language Models Learn to Skip Steps?

Frustratingly Easy Test-Time Adaptation of Vision-Language Models

Improving Spoken Language Modeling with Phoneme Classification: A Simple Fine-tuning Approach

CoTran: An LLM-based Code Translator using Reinforcement Learning with Feedback from Compiler and Symbolic Execution

Reliable and Compact Graph Fine-tuning via GraphSparse Prompting

Natural GaLore: Accelerating GaLore for memory-efficient LLM Training and Fine-tuning

The effect of fine-tuning on language model toxicity

Reasoning, Memorization, and Fine-Tuning Language Models for Non-Cooperative Games

Fine-Tuning Language Models on Multiple Datasets for Citation Intention Classification

Instruction Matters: A Simple yet Effective Task Selection for Optimized Instruction Tuning of Specific Tasks

What Do Speech Foundation Models Not Learn About Speech?

Dual Prototype Evolving for Test-Time Generalization of Vision-Language Models

Reconsidering Degeneration of Token Embeddings with Definitions for Encoder-based Pre-trained Language Models

RoseLoRA: Row and Column-wise Sparse Low-rank Adaptation of Pre-trained Language Model for Knowledge Editing and Fine-tuning

A Novel LLM-based Two-stage Summarization Approach for Long Dialogues

Semi-Supervised Fine-Tuning of Vision Foundation Models with Content-Style Decomposition

Vision-Language Models are Strong Noisy Label Detectors

Brain-JEPA: Brain Dynamics Foundation Model with Gradient Positioning and Spatiotemporal Masking

MINERS: Multilingual Language Models as Semantic Retrievers

Prithvi WxC: Foundation Model for Weather and Climate

Fine-tuning Pre-trained Language Models for Few-shot Intent Detection: Supervised Pre-training and Isotropization

TransformerRanker: A Tool for Efficiently Finding the Best-Suited Language Models for Downstream Classification Tasks

Adversarial Prompt Tuning for Vision-Language Models

Noise-Tolerant Few-Shot Unsupervised Adapter for Vision-Language Models

How Does Fine-Tuning Impact Out-of-Distribution Detection for Vision-Language Models?