语言大模型 / LLM

Adaptive BPE Tokenization for Enhanced Vocabulary Adaptation in Finetuning Pretrained Language Models

Gunjan Balde, Soumyadeep Roy, Mainack Mondal, Niloy Ganguly

机构 * Indian Institute of Technology Kharagpur（印度理工学院卡拉格浦分校） 纠错

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL

Comments 11 pages. Accepted at EMNLP Findings 2024 (The 2024 Conference on Empirical Methods in Natural Language Processing)

You Don't Need All Attentions: Distributed Dynamic Fine-Tuning for Foundation Models

Shiwei Ding, Lan Zhang, Zhenlin Wang, Giuseppe Ateniese, Xiaoyong Yuan

专题命中 指令微调 ：foundation model(title,abstract)；分类 cs.LG

How to Enhance Downstream Adversarial Robustness (almost) without Touching the Pre-Trained Foundation Model?

Meiqi Liu, Zhuoqun Huang, Yue Xing

专题命中 指令微调 ：foundation model(title,abstract)；分类 cs.LG

Comments 22 pages, 2 figures, 12 tables. Include 10 pages of appendices

Enhancing Code LLM Training with Programmer Attention

Yifan Zhang, Chen Huang, Zachary Karas, Dung Thuy Nguyen, Kevin Leach, Yu Huang

专题命中 指令微调 ：LLM(title,abstract)；分类 cs.LG

Examining the Threat Landscape: Foundation Models and Model Stealing

Ankita Raj, Deepankar Varma, Chetan Arora

专题命中 指令微调 ：foundation model(title,abstract)；分类 cs.LG

Comments Accepted to BMVC 2024

Journal ref 35th British Machine Vision Conference 2024, Glasgow, UK, November 25-28, 2024

Prompt Tuning with Soft Context Sharing for Vision-Language Models

Kun Ding, Ying Wang, Pengzhang Liu, Qiang Yu, Haojian Zhang, Shiming Xiang, Chunhong Pan

专题命中 指令微调 ：language model(title,abstract)；分类 cs.AI

Comments 20 pages

Efficient Fine-Tuning of Single-Cell Foundation Models Enables Zero-Shot Molecular Perturbation Prediction

Sepideh Maleki, Jan-Christian Huetter, Kangway V. Chuang, David Richmond, Gabriele Scalia, Tommaso Biancalani

专题命中 指令微调 ：foundation model(title,abstract)；分类 cs.LG

EffOWT: Transfer Visual Language Models to Open-World Tracking Efficiently and Effectively

Bingyang Wang, Kaer Huang, Bin Li, Yiqiang Yan, Lihe Zhang, Huchuan Lu, You He

专题命中 指令微调 ：language model(title,abstract)；分类 cs.AI

Comments 11 pages, 5 figures

Confidence-calibrated covariate shift correction for few-shot classification in Vision-Language Models

Behraj Khan, Rizwan Qureshi, Nouman Muhammad Durrani, Tahir Syed

专题命中 指令微调 ：language model(title)；foundation model(abstract)；分类 cs.LG

Steering off Course: Reliability Challenges in Steering Language Models

Patrick Queiroz Da Silva, Hari Sethuraman, Dheeraj Rajagopal, Hannaneh Hajishirzi, Sachin Kumar

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL

Large (Vision) Language Models are Unsupervised In-Context Learners

Artyom Gadetsky, Andrei Atanov, Yulun Jiang, Zhitong Gao, Ghazal Hosseini Mighan, Amir Zamir, Maria Brbic

专题命中 指令微调 ：language model(title,abstract)；分类 cs.LG

Comments ICLR 2025 camera-ready

CARE: Confidence-Aware Regression Estimation of building density fine-tuning EO Foundation Models

Nikolaos Dionelis, Jente Bosmans, Nicolas Longépé

专题命中 指令微调 ：foundation model(title,abstract)；分类 cs.LG

Comments 7 pages, 4 figures, Submitted

PolypSegTrack: Unified Foundation Model for Colonoscopy Video Analysis

Anwesa Choudhuri, Zhongpai Gao, Meng Zheng, Benjamin Planche, Terrence Chen, Ziyan Wu

专题命中 指令微调 ：foundation model(title,abstract)；分类 cs.AI

CellVTA: Enhancing Vision Foundation Models for Accurate Cell Segmentation and Classification

Yang Yang, Xijie Xu, Yixun Zhou, Jie Zheng

专题命中 指令微调 ：foundation model(title,abstract)；分类 cs.LG

LongViTU: Instruction Tuning for Long-Form Video Understanding

Rujie Wu, Xiaojian Ma, Hai Ci, Yue Fan, Yuxuan Wang, Haozhe Zhao, Qing Li, Yizhou Wang

专题命中 指令微调 ：instruction tuning(title)；SFT(abstract)；分类 cs.LG

TerraTorch: The Geospatial Foundation Models Toolkit

Carlos Gomes, Benedikt Blumenstiel, Joao Lucas de Sousa Almeida, Pedro Henrique de Oliveira, Paolo Fraccaro, Francesc Marti Escofet, Daniela Szwarcman, Naomi Simumba, Romeo Kienzler, Bianca Zadrozny

专题命中 指令微调 ：foundation model(title,abstract)；分类 cs.LG

Comments IGARSS 2025

Thin-Shell-SfT: Fine-Grained Monocular Non-rigid 3D Surface Tracking with Neural Deformation Fields

Navami Kairanda, Marc Habermann, Shanthika Naik, Christian Theobalt, Vladislav Golyanik

专题命中 指令微调 ：SFT(title,abstract)；分类 cs.LG

Comments 15 pages, 12 figures and 3 tables; project page: https://4dqv.mpiinf.mpg.de/ThinShellSfT; CVPR 2025

Human Motion Instruction Tuning

Lei Li, Sen Jia, Jianhao Wang, Zhongyu Jiang, Feng Zhou, Ju Dai, Tianfang Zhang, Zongkai Wu, Jenq-Neng Hwang

专题命中 指令微调 ：instruction tuning(title,abstract)；分类 cs.AI

Comments Accepted by CVPR 2025

Vocabulary-level Memory Efficiency for Language Model Fine-tuning

Miles Williams, Nikolaos Aletras

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL

Comments RepL4NLP 2025

CLIP-Adapter: Better Vision-Language Models with Feature Adapters

Peng Gao, Shijie Geng, Renrui Zhang, Teli Ma, Rongyao Fang, Yongfeng Zhang, Hongsheng Li, Yu Qiao

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL

Comments Accepted by IJCV

Re-Imagining Multimodal Instruction Tuning: A Representation View

Yiyang Liu, James Chenhao Liang, Ruixiang Tang, Yugyung Lee, Majid Rabbani, Sohail Dianat, Raghuveer Rao, Lifu Huang, Dongfang Liu, Qifan Wang, Cheng Han

专题命中 指令微调 ：instruction tuning(title,abstract)；分类 cs.LG

VP-NTK: Exploring the Benefits of Visual Prompting in Differentially Private Data Synthesis

Chia-Yi Hsu, Jia-You Chen, Yu-Lin Tsai, Chih-Hsun Lin, Pin-Yu Chen, Chia-Mu Yu, Chun-Ying Huang

专题命中 指令微调 ：prompting(title,abstract)；分类 cs.LG

Comments Accepted by ICASSP 2025

Adapters for Altering LLM Vocabularies: What Languages Benefit the Most?

HyoJung Han, Akiko Eriguchi, Haoran Xu, Hieu Hoang, Marine Carpuat, Huda Khayrallah

专题命中 指令微调 ：LLM(title)；language model(abstract)；分类 cs.CL

Comments ICLR2025

Surgical-LVLM: Learning to Adapt Large Vision-Language Model for Grounded Visual Question Answering in Robotic Surgery

Guankun Wang, Long Bai, Wan Jun Nah, Jie Wang, Zhaoxi Zhang, Zhen Chen, Jinlin Wu, Mobarakol Islam, Hongbin Liu, Hongliang Ren

专题命中 指令微调 ：language model(title,abstract)；分类 cs.AI

Comments The manuscript is accepted by ICLR 2025 FM-Wild Workshop

Rethinking Few-Shot Adaptation of Vision-Language Models in Two Stages

Matteo Farina, Massimiliano Mancini, Giovanni Iacca, Elisa Ricci

专题命中 指令微调 ：language model(title,abstract)；分类 cs.LG

Comments Camera-ready version for CVPR 2025 (w/ SuppMat, 23 pages)

Compound Expression Recognition via Large Vision-Language Models

Jun Yu, Xilong Lu

专题命中 指令微调 ：language model(title,abstract)；分类 cs.AI

GPT-PPG: A GPT-based Foundation Model for Photoplethysmography Signals

Zhaoliang Chen, Cheng Ding, Saurabh Kataria, Runze Yan, Minxiao Wang, Randall Lee, Xiao Hu

专题命中 指令微调 ：foundation model(title,abstract)；分类 cs.LG

CAPT: Class-Aware Prompt Tuning for Federated Long-Tailed Learning with Vision-Language Model

Shihao Hou, Xinyi Shang, Shreyank N Gowda, Yang Lu, Chao Wu, Yan Yan, Hanzi Wang

专题命中 指令微调 ：language model(title,abstract)；分类 cs.LG

Your Large Vision-Language Model Only Needs A Few Attention Heads For Visual Grounding

Seil Kang, Jinyeong Kim, Junhyeok Kim, Seong Jae Hwang

专题命中 指令微调 ：language model(title,abstract)；分类 cs.AI

GRNFormer: A Biologically-Guided Framework for Integrating Gene Regulatory Networks into RNA Foundation Models

Mufan Qiu, Xinyu Hu, Fengwei Zhan, Sukwon Yun, Jie Peng, Ruichen Zhang, Bhavya Kailkhura, Jiekun Yang, Tianlong Chen

专题命中 指令微调 ：foundation model(title,abstract)；分类 cs.LG