语言大模型 / LLM

Just Shift It: Test-Time Prototype Shifting for Zero-Shot Generalization with Vision-Language Models

Elaine Sui, Xiaohan Wang, Serena Yeung-Levy

专题命中 指令微调 ：language model(title,abstract)；分类 cs.AI、cs.LG

Comments Accepted at WACV 2025

CryoFM: A Flow-based Foundation Model for Cryo-EM Densities

Yi Zhou, Yilai Li, Jing Yuan, Quanquan Gu

专题命中 指令微调 ：foundation model(title,abstract)；分类 cs.AI、cs.LG

SatVision-TOA: A Geospatial Foundation Model for Coarse-Resolution All-Sky Remote Sensing Imagery

Caleb S. Spradlin, Jordan A. Caraballo-Vega, Jian Li, Mark L. Carroll, Jie Gong, Paul M. Montesano

专题命中 指令微调 ：foundation model(title,abstract)；分类 cs.AI、cs.LG

Comments 19 pages, 5 figures

Adapter-based Approaches to Knowledge-enhanced Language Models -- A Survey

Alexander Fichtl, Juraj Vladika, Georg Groh

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments 12 pages, 4 figures. Published at KEOD24 via SciTePress

Journal ref In Proceedings of the 16th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management - KEOD 2024; ISBN 978-989-758-716-0; ISSN 2184-3228, SciTePress, pages 95-107

MANTIS: Interleaved Multi-Image Instruction Tuning

Dongfu Jiang, Xuan He, Huaye Zeng, Cong Wei, Max Ku, Qian Liu, Wenhu Chen

专题命中 指令微调 ：instruction tuning(title,abstract)；分类 cs.CL、cs.AI

Comments 13 pages, 3 figures, 13 tables

Journal ref Transactions on Machine Learning Research 2024

Rethinking Misalignment in Vision-Language Model Adaptation from a Causal Perspective

Yanan Zhang, Jiangmeng Li, Lixiang Liu, Wenwen Qiang

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted by NeurIPS 2024

Rethinking Weight Decay for Robust Fine-Tuning of Foundation Models

Junjiao Tian, Chengyue Huang, Zsolt Kira

专题命中 指令微调 ：foundation model(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted to Neurips 2024

Applying sparse autoencoders to unlearn knowledge in language models

Eoin Farrell, Yeu-Tong Lau, Arthur Conmy

专题命中 指令微调 ：language model(title,abstract)；分类 cs.AI、cs.LG

Prompt Tuning Strikes Back: Customizing Foundation Models with Low-Rank Prompt Adaptation

Abhinav Jain, Swarat Chaudhuri, Thomas Reps, Chris Jermaine

专题命中 指令微调 ：foundation model(title,abstract)；分类 cs.AI、cs.LG

Comments 14 pages, 8 figures, 4 tables

COMFORT: A Continual Fine-Tuning Framework for Foundation Models Targeted at Consumer Healthcare

Chia-Hao Li, Niraj K. Jha

专题命中 指令微调 ：foundation model(title,abstract)；分类 cs.AI、cs.LG

Comments 25 pages, 10 figures. This work has been submitted to the ACM for possible publication

End-to-end Planner Training for Language Modeling

Nathan Cornille, Florian Mai, Jingyuan Sun, Marie-Francine Moens

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments 14 pages

nach0-pc: Multi-task Language Model with Molecular Point Cloud Encoder

Maksim Kuznetsov, Airat Valiev, Alex Aliper, Daniil Polykovskiy, Elena Tutubalina, Rim Shayakhmetov, Zulfat Miftahutdinov

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

First Place Solution to the ECCV 2024 BRAVO Challenge: Evaluating Robustness of Vision Foundation Models for Semantic Segmentation

Tommie Kerssies, Daan de Geus, Gijs Dubbelman

专题命中 指令微调 ：foundation model(title,abstract)；分类 cs.AI、cs.LG

Comments v2 fixes ECE and FPR@95, among other small changes. arXiv admin note: substantial text overlap with arXiv:2409.15107

NuwaTS: a Foundation Model Mending Every Incomplete Time Series

Jinguo Cheng, Chunwei Yang, Wanlin Cai, Yuxuan Liang, Qingsong Wen, Yuankai Wu

专题命中 指令微调 ：foundation model(title)；language model(abstract)；分类 cs.AI、cs.LG

Comments 25 pages, 14 figures

KALIE: Fine-Tuning Vision-Language Models for Open-World Manipulation without Robot Data

Grace Tang, Swetha Rajkumar, Yifei Zhou, Homer Rich Walke, Sergey Levine, Kuan Fang

专题命中 指令微调 ：language model(title,abstract)；分类 cs.AI、cs.LG

Comments 8 pages, 7 figures

Eliciting Instruction-tuned Code Language Models' Capabilities to Utilize Auxiliary Function for Code Generation

Seonghyeon Lee, Suyeon Kim, Joonwon Jang, Heejae Chon, Dongha Lee, Hwanjo Yu

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments EMNLP 2024 Findings Short

Multi-Modal Adapter for Vision-Language Models

Dominykas Seputis, Serghei Mihailov, Soham Chatterjee, Zehao Xiao

专题命中 指令微调 ：language model(title,abstract)；分类 cs.AI、cs.LG

Retrieval-Augmented Instruction Tuning for Automated Process Engineering Calculations : A Tool-Chaining Problem-Solving Framework with Attributable Reflection

Sagar Srinivas Sakhinana, Geethan Sannidhi, Venkataramana Runkana

专题命中 指令微调 ：instruction tuning(title)；language model(abstract)；分类 cs.AI、cs.LG

Comments Accepted for publication at ML4CCE workshop at ECML PKDD 2024. Please find the link: https://ml4cce-ecml.com/#agenda

SPARSEFIT: Few-shot Prompting with Sparse Fine-tuning for Jointly Generating Predictions and Natural Language Explanations

Jesus Solano, Mardhiyah Sanni, Oana-Maria Camburu, Pasquale Minervini

专题命中 指令微调 ：prompting(title)；language model(abstract)；分类 cs.CL、cs.AI

Journal ref ACL 2024

Enhancing Robustness of Retrieval-Augmented Language Models with In-Context Learning

Seong-Il Park, Seung-Woo Choi, Na-Hyun Kim, Jay-Yoon Lee

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments 10 pages, 2 figures

Journal ref KnowledgeNLP@ACL 2024

Hadamard Adapter: An Extreme Parameter-Efficient Adapter Tuning Method for Pre-trained Language Models

Yuyan Chen, Qiang Fu, Ge Fan, Lun Du, Jian-Guang Lou, Shi Han, Dongmei Zhang, Zhixu Li, Yanghua Xiao

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments Accepted to CIKM 2023 (Long Paper)

LAPT: Label-driven Automated Prompt Tuning for OOD Detection with Vision-Language Models

Yabin Zhang, Wenjie Zhu, Chenhang He, Lei Zhang

专题命中 指令微调 ：language model(title,abstract)；分类 cs.AI、cs.LG

Comments ECCV2024; Codes and Supp. are available at: https://github.com/YBZh/LAPT

Automatic Pruning of Fine-tuning Datasets for Transformer-based Language Models

Mohammadreza Tayaranian, Seyyed Hasan Mozafari, Brett H. Meyer, James J. Clark, Warren J. Gross

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.LG

Comments 28 pages, 17 figures. Accepted at the Third Conference on Lifelong Learning Agents (CoLLAs 2024)

Deep Content Understanding Toward Entity and Aspect Target Sentiment Analysis on Foundation Models

Vorakit Vorakitphan, Milos Basic, Guilhaume Leroy Meline

专题命中 指令微调 ：foundation model(title)；language model(abstract)；分类 cs.CL、cs.AI

Comments Proceedings of the 41 st International Conference on Machine Learning, Vienna, Austria. PMLR 235, 2024. Copyright 2024 by the author(s)

Mitigating Social Biases in Language Models through Unlearning

Omkar Dige, Diljot Singh, Tsz Fung Yau, Qixuan Zhang, Borna Bolandraftar, Xiaodan Zhu, Faiza Khan Khattak

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

PathoLM: Identifying pathogenicity from the DNA sequence through the Genome Foundation Model

Sajib Acharjee Dip, Uddip Acharjee Shuvo, Tran Chau, Haoqiu Song, Petra Choi, Xuan Wang, Liqing Zhang

专题命中 指令微调 ：foundation model(title)；language model(abstract)；分类 cs.CL、cs.LG

Comments 9 pages, 3 figures

Candidate Pseudolabel Learning: Enhancing Vision-Language Models by Prompt Tuning with Unlabeled Data

Jiahan Zhang, Qi Wei, Feng Liu, Lei Feng

专题命中 指令微调 ：language model(title,abstract)；分类 cs.AI、cs.LG

Comments Accepted by ICML2024

Advancing High Resolution Vision-Language Models in Biomedicine

Zekai Chen, Arda Pekis, Kevin Brown

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

Comments 15 pages

DEFT: Data Efficient Fine-Tuning for Pre-Trained Language Models via Unsupervised Core-Set Selection

Devleena Das, Vivek Khetan

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI

SuperPos-Prompt: Enhancing Soft Prompt Tuning of Language Models with Superposition of Multi Token Embeddings

MohammadAli SadraeiJavaeri, Ehsaneddin Asgari, Alice Carolyn McHardy, Hamid Reza Rabiee

专题命中 指令微调 ：language model(title,abstract)；分类 cs.CL、cs.AI